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PREFACE 


This  report  presents  the  methods  and  results  of  an  evaluation  of  the 
llniLed  States  Army  Aviatit'n  Center's  Rotary  WlnR  Aviator  Refresher 
Lrainiiig  (RWART)  Course  of  Instruction.  Historical  research  indicates 
that  the  developmental  concepts  of  Instructional  Systems  Development 
(ISD)  have  never  been  applied  to  this  course.  This  evaluation  precedes 
the  planned  initiation  of  a  task  analysis  by  Training  Analysis  Division 
(TAD)  scheduled  for  the  third  quarter  of  fiscal  year  1981. 

The  evaluation  took  place  during  the  period  of  January  through  March  of 
1981.  Data  gathering  was  limited  predominately  to  Internal  Institutional 
sources . 

The  point  of  contact  for  inquiry  or  comment  concerning  evaluation 
content  is  Captain  Shivers,  Internal  Instructional  Systems  Evaluation 
Branch,  Evaluation  Division,  Directorate  of  Evaluation  and  Standardiza¬ 
tion,  Fort  Rucker,  Alabama  ATZQ-ES-E,  36362:  255-2415/6571,  Autovon 

558-2415/6571. 
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RWARTC  EVALUATION  ABSTRACT 


1.  Pl!RPOSE:  To  complete  a  written  evaluation  of  the  Rotary  Wins 
Aviator  Refresher  Training  Course  (RWARTC)  which  assesses  course  effec¬ 
tiveness  in  fulfilling  its  purpose  and  objectives.  Tangential  topics 
will  be  discussed  in  a  detail  commensurate  with  course  impact.  Such 
topics  will  be  recommended  as  areas  for  additional  study. 

2.  OBJECTIVES: 

a.  To  assess  the  degree  to  which  course  development  and  change  has 
been  accomplished  in  reference  to  the  guidelines  of  the  Instructional 
Systems  Development  procedure. 

b.  To  collect  and  analyze  student  performance  data  in  the  form  of 
flight  checkride  grades,  flight  hours,  and  academic  diagnostic  test 
scores  from  actual  flight  records. 

c.  To  obtain  printout  data  on  subject  sample  from  Management 
Information  Systems  Office  (MISO)  to  provide  confirmation  of  data 
accuracy . 

d.  To  review  a  representative  number  of  student  course  critiques  to 
determine  trends  of  opinion  and  quantify  repetitive  comments. 

e.  To  conduct  informal  interviews  with  instructional  personnel  to 
obtain  opinion  data  reflecting  various  perspectives  and  conclusions 
concerning  course  strengths  and  weaknesses. 

f.  To  review  selected  pertinent  USAAVNC  regulations  and  published 
guidelines  to  determine  to  what  extent  documentation  is  required.  Also, 
to  carry  out  research  to  determine  the  extent  to  which  these  require¬ 
ments  are  met,  and  to  estimate  the  impact  of  these  administrative 
requirements  on  the  quality  of  training. 

g.  To  review  course  materials  to  determine  the  extent  to  which  the 
training  materials  support  and  integrate  with  the  course  purpose  and 
training  objectives. 

h.  In  the  course  of  the  evaluation,  to  informally  circulate  the 
current  working  POI  change  proposals  for  the  RWARTC  among  concerned 
course  personnel.  This  will  be  accomplished  as  a  service  for  the  course 
developers  and  is  intended  to  provide  direct  feedback  on  their  current 
ideas.  This  material  will  be  included  in  an  information  section  in  the 
evaluation. 

3.  SUMMARY  OF  FINDINGS: 

'  a.  The  data  extracted  From  tlu*  student  fliglit  records  did  not 

precisely  match  the  printout  data  obtained  from  MISO  for  the  subject 
sample'  classes  80-19  through  80-28.  Thirty-five  discrepancies  w<'rt' 
Identified.  Of  these,  five  were  errors  made  by  the  project  officer 


anti  liiirty  were  madt!  somi'wln'ro  within  the  data  collection/prot'o.ssi n;; 

|)roi  ednrc.  Nine  of  the  thirty-six  sample  members  had  no  printout  data 
available. 

b.  Due  to  consistently  low  priority  assessment,  the  Rotary  Wing 
Aviator  Refresher  Training  Course  has  never  been  developed  or  reviewed 
in  accordance  with  the  principles  of  Instructional  Systems  Development. 

A  cask  analysis  of  the  course  is  presently  scheduled  to  commence  in  the 
third  quarter  of  fiscal  year  1981. 

c.  Historical  and  course  development  records  and  materials  do  not 
comply  with  certain  requirements  of  USAAVNC  Regulation  350-14  Training 
Examinations  and  Standards,  USAAVNC  Regulation  350-15  Criterion  Referenced 
Examinations,  and  USAAVNC  Pamphlet  310-4  Preparation  and  Use  of  Lesson 
Plans  and  Instructor  Guides.  The  majority  of  the  discrepancies  are 
attributable  to  the  recent  effective  date  of  many  requirements  and  to 

the  fact  that  ISD  principles  have  yet  to  be  applied  to  the  course. 

Specific  discrepancy  items  are  noted  in  the  body  of  the  report. 

d.  With  the  exception  of  compliance  with  administrative  guidelines, 
the  course  material  is  predominately  well  coordinated  and  complimentary. 
The  course  objectives  are  being  supported  and  achieved.  The  students 
are  predominately  pleased  with  all  aspects  of  the  course.  The  RWARTC  is 
currently  fulfilling  the  purpose  and  objectives  established  in  the  POI 
in  an  excellent  manner. 

e.  The  relation  of  the  ATM  to  maneuver  standards  and  flight  grading 
has  been  identified  as  a  serious  problem  pervading  the  entire  institution. 
The  problem  centers  in  the  method  of  strict  application  of  the  ATM 
standards  to  student  flight  training  and  the  use  of  the  resultant  grades 
as  feedback  information  for  institutional  management,  funding,  and 
evaluation  of  effectiveness. 

f.  Statistical  analysis  of  course  data  indicates  a  well  managed 
course  with  acceptable  statistical  deviation  from  established  objective 
performance  goals.  In  those  cases  in  which  statistically  significant 
deviation  was  established,  an  examination  of  actual  time  deviations 
revealed  a  realistic  difference  that  is  inconsequential. 

g.  A  review  of  course  critiques  indicated  that  the  vast  majority  of 
students  feel  the  course  is  excellent  and  of  benefit  to  them.  Numerous 
comments  lauded  the  instructor  pilots  and  2C35  instructors  as  being 
outstanding  trainers  who  were  highly  professional.  The  only  other  major 
comment  was  that  more  time  should  be  made  available  for  tactics  and 
night  vision  goggle  related  training. 

h.  Problem  areas  within  the  course,  as  perceived  by  Instructors  and 
course  management  personnel,  are  insufficient  personnel,  time,  and 
resources,  increasing  lERW  student  input  causing  less  available  resources 
and  less  access  to  more  convenient  training  facilities,  and  the  lact 
that  RWARTC  graduates  (future  commanders  and  instructor  pilots)  lack 
certain  skills  acquired  by  lERW  graduates. 


i.  Th«.‘  Combat  Aviator  Refresher  Training  Course  (CARTC)  review  was 
completed  as  an  inf ormat ion/ feedback  endeavor  separate  from  the  primary 
intent  of  the  evaluation.  Personnel  associated  with  the  CARTC  agree 
that  key  unit  personnel  and  more  experienced  aviators  should  have  the 
same  knowledges  and  skills  of  current  aviation  doctrine  as  recent  TERW 
graduates.  This  factor  is  at  least  partially  supported  by  student 
course  critiques  and  feedback  from  the  Aviation  Center  Training  Analysis 
and  Assistance  team  visits.  However,  there  is  concern  and  confusion 
concerning  whether  the  course  is  a  "refresher"  or  a  "qualification" 
course,  how  these  apparently  conflicting  purposes  integrate,  and  whether 
institutional  facilities  and  resources  can  support  such  a  program. 

4.  RECOMMENDATIONS: 

a.  Information  for  the  RWARTC  obtained  from  MISO  contained  a  relatively 
large  number  of  errors  when  compared  to  the  flight  records  on  file  at 

DOAT.  The  fact  that  data  was  missing  for  several  sample  members  increases 
the  cause  for  concern.  It  is  recommended  that  the  data  collection  and 
processing  procedure  be  reviewed  to  determine  the  cause  of  the  errors  in 
the  system,  and  to  determine  how  widespread  the  error  rate  is  within  the 
management  information  system.  (MISO  proponency) 

b.  The  RWARTC  is  of  such  low  priority  that  it  has  never  benefitted 
from  the  ISD  procedure.  This  suggests  that  DTD  might  have  insufficient 
personnel  resources  to  adequately  support  the  current  developmental 
course  load.  It  is  recommended  that  a  study  be  conducted  to  determine 

if  tlie  most  effective  utility  is  being  gained  from  current  course  develop¬ 
ment  resource  distribution,  or  if  more  efficient  resource  utilization 
alternatives  are  available.  (DTD  proponency) 

c .  It  is  recommended  that  all  parties  to  the  RWARTC  be  reminded  of 
the  regulatory  requirements  of  USAAVNC  Reg  350-14,  350-15,  and  USAAVNC 
Pam  350-4  to  Insure  continued  progression  toward  fulfilling  documentary 
requirements.  Also,  the  utility  of  each  documentation  requirement 
should  be  assessed  to  insure  that  only  minimum  essential  management 
documentation  is  generated.  (DTD  and  DOTD  proponency) 

d.  The  current  flight  grading  system  is  adequate  to  fulfill  instructor/ 
student  feedback  needs,  but  fails  to  provide  meaningful  ATM  standards 
proficiency  progression  information  to  enable  quantitative  assessment  of 
training  needed  for  institutional  management.  It  is  recommended  that 
efforts  be  initiated  to  modify  the  flight  grading  system  to  satisfy  both 
functions  of  the  system.  (DTD  proponency) 

5.  CONCLUSION:  The  RWARTC  is  accomplishing  the  current  course  objective 
in  an  outstanding  manner.  The  personnel  associated  with  the  course  are 
highly  professional  and  are  motivated  to  insure  that  the  students  achieve 
maximum  benefit.  The  course  could  be  more  comprehensive  in  scope,  and 
plans  are  under  way  to  submit  such  a  proposal.  Tiie  planned  ISD  review 

of  the  course  development  should  serve  to  fill  the  lack  of  regulatorv 
documentation  and  may  provide  further  evidence  for  the  need  for  expanding 
the  training  as  outlined  in  the  CARTC  proposal.  The  RWARTC  is  a  vc'ry 
valuable  course  for  the  personnel  returning  to  aviation  assignments. 

Tiie  efforts  of  all  personnel  involved  are  commendable. 
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1.  PURPOSE:  To  complete  a  written  evaluation  of  the  Rotary  Wing 
Aviator  Refresher  Training  Course  (RWARTC)  wliich  assesses  course  effec¬ 
tiveness  in  fulfilling  its  purpose  and  objectives.  Tangential  topics 
will  be  discussed  in  a  detail  commensurate  with  course  impact.  Such 
topics  will  be  recommended  as  areas  for  additional  study. 

2.  OBJECTIVES: 

a.  To  assess  the  degree  to  which  course  development  and  change  has 
been  accomplished  in  reference  to  the  guidelines  of  the  Instructional 
Systems  Development  procedure. 

b.  To  collect  and  analyze  student  performance  data  in  the  form  of 
flight  checkride  grades,  flight  hours,  and  academic  diagnostic  '•.est 
scores  from  actual  flight  records. 

c.  To  obtain  printout  data  on  subject  sample  from  Manag  t 
Information  Systems  Office  (MISO)  to  provide  confirmation  of  ta 
accuracy. 

d.  To  review  a  representative  number  of  student  course  ci-itiques  to 
determine  trends  of  opinion  and  quantify  repetitive  comments. 

e.  To  conduct  informal  Interviews  with  instructional  personnel  to 
obtain  opinion  data  reflecting  various  perspectives  and  conclusions 
concerning  course  strengths  and  weaknesses. 

f.  To  review  selected  pertinent  USAAVNC  regulations  and  published 
guidelines  to  determine  to  what  extent  documentation  is  required.  Also, 
to  carry  out  research  to  determine  the  extent  to  which  these  require¬ 
ments  are  met,  and  to  estimate  the  impact  of  these  administrative 
requirements  on  the  quality  of  training. 

g.  To  review  course  materials  to  determine  the  extent  to  which  the 
training  materials  support  and  Integrate  with  the  course  purpose  and 
training  objectives. 

h.  In  the  course  of  the  evaluation,  to  informally  circulate  the 
current  working  POI  change  proposals  for  the  RWARTC  among  concerned 
course  personnel.  This  will  be  accomplished  as  a  service  for  the  course 
developers  and  is  intended  to  provide  direct  feedback  on  their  current 
ideas.  This  material  will  be  included  in  an  information  section  in  the 
evaluation. 

3.  METHODOLOGY: 

a.  Ten  consecutive  completed  RWART  classes  were  selected  for  the 
evaluation.  The  sample  includes  classes  80-19  throurji  80-28.  A  sample 
of  individuals  totaling  thirty-six  members  was  drauTi  from  the  subject 


^  Lissom.  The  flight  records  of  these  ttiLrty-six  sonijiK'  tiiiMiihi ■  r.' .  v;ere 
re'.’iewed  to  extract  the  name,  rank,  social  security  number,  c  lass 
iHimber,  instrument  flight  grades  (diagnostic  and  evaiuationf,  inst  r'li'ii  ai 
I  I  ight  time  (2B2A,  IJH- 1 ,  and  combined),  contact  flight  evaluaLion  /radi  , 
contact  I liglit  time  (day,  night,  and  combined),  tactics  refresher  i I iahi 
i  imo,  and  niimher  ol  times  flown  witli  guest  instruc:tor.  Academic 
wci'e  found  at  Maintenance  Training  Divition  (MTD)  and  Instrument  I'.t.inc  i;. 
fi  St  scores  for  the  diagnostic  exams  on  UH-1  Systems  and  instrunient 
I'liglit  Rules  were  extracted  for  each  sample  member.  A  reiinest  for  a 
computer  printout  of  the  subject  sample  classes  was  submitted  to  i he 
'"lanagemenL  Information  Systems  Office  (MTSO)  .  Tiiis  tiata  was  used  to 
confirm  tlie  accuracy  of  the  data  extracted  from  flight  records.  Tire 
accumulated  data  were  subjected  to  selected  descriptive  and  analytic-al 
statistical  methods.  The  results  of  the  statistical  applications  are 
detailed  in  the  body  of  the  report. 

b.  A  historical  and  course  development  documentation  trace  was  made 
by  inquiry  through  appropriate  personnel  in  the  Training  Analysis  ai  li 
Design  Division  and  Course  Development  Division  of  the  Directornti'  ol 
I  raining  Developments.  Appropriate  elements  of  the  Department  of 
Academic  Training  (DOAT)  and  the  Department  of  Fliglit  Training  (DOi'd') 
were  contacted  to  obtain  access  to  records  maintained  tliere.  Tlie 
information  obtained  was  used  to  form  a  data  base  for  analysis  and  for 
comparison  with  the  requirements  of  US/\AVNC  regulations  and  pamplilets . 

c  .  A  set  of  course  material  was  obtained  from  Training  Literature 
Management  Branch  and  the  appropriate  elements  of  DOAT  and  DOFT  provided 
access  to  examinations  and  any  instructional  materLil  handed  out  in 
class.  The  material  was  reviewed  for  consistency  of  objectives  and 
tasks.  The  examinations  were  reviewed  to  determine  whether  the  questions 
tested  appropriate  learning  objectives.  No  tost  analysis  material  was 
aval lablc. 

d.  A  search  was  conducted  to  locate  all  USAAVNC  regulations  and 
pamphlets  applicable  to  course  development  and  instructional  nctivltirs. 
A  comparison  was  made  to  determine  the  extent  to  which  requirements  have 
tu>.'n  met.  Additionally,  a  subjective  opinion  statement  was  composed  to 
estimate  the  impact  of  regulatory  requirements  and  compliance  upon  the 
liualfty  and  effectiveness  of  training. 

e.  Student  critiques  for  the  sample  RWARTC  classi's  were  not  avaiiei> 
l!('wever,  more  current  rriti(|ues  were  available.  One-hundred  and  ten 
(Mi')  student  c'ritiques  were  reviewed.  Of  these,  sixty-tlirei'  (b  i) 
eiiiitalned  written  comments.  These  comments  were  rank  ordenal  hv  frecpK'ii 
el  occurrence  and  the  results  were*  presented  in  writing  and  ■  iiart  form 
in  the  body  of  the  report. 

1.  Interviews  were  conducted  with  i nstruc t i oni  1  personnel.  iiu 
in!cr\iews  were  conducted  informally  to  allow  individual  views  Le  he 
hruii’iit  out.  Tojiics  of  discussion  initiated  liv  the  i  n  terv  i  oiv’i.t  w.t' 
ice'i'rK'y  of  resources,  suitability  and  comprt'hens  iveness  of  I'eurse 
liv  olives,  aiq)  I  Icali  i  1  ity  ot  center  regulatorv  rt'r;  u  i  r  ement  s  ,  iiul  ipi.’lii. 

I  tlie  nri'p'osed  change  to  the  RWARTC.  Other  miscel  laiu'ous  mhiecis  ■•u  i. 
d  i  I  iMsed  at  the  initiative  of  the  personnel  i  n  I  e  rv  i  ew' c] . 


g.  The  forthcominfj  POT  change,  including  various  combat  skills 
qua]  i  t'irations,  was  obtained  from  Course  Development  Division.  The 
proposals  were  presented  to  various  instructors  and  course  management 
personnel  in  order  to  obtain  opinion  feedback  to  assist  tlie  Course 
Development  Project  Officers  in  refining  the  POI . 

4.  urSTORICAL  AND  COURSE  DEVELOPMENT  DATA: 

a.  An  attempt  was  made  to  trace  Instructional  Systems  Development 
(ISD)  tlirough  the  school  organizational  structure.  There  were  no  histor¬ 
ical  or  working  data  available  at  Training  Analysis  Brandi.  However,  a 
RWARTC  course  task  analysis  is  scheduled  to  begin  in  the  third  quarter 

of  fiscal  year  1981.  Training  Design  Brandi  cited  the  fact  that  no 
analysis  jiroducts  have  been  forwarded  for  their  action.  They  also 
referred  to  the  scheduled  task  analysis  that  will  be  initiated  in  the 
near  future.  A  visit  to  Course  Development  Division  produced  an  Instructional 
Kile  (IISAAVNC  Form  60h,  1  Apr  80)  used  in  conjunction  with  USAAVNC  Pam 
310-4.  A  copy  of  the  cover  sheet /directory  of  this  file  is  Included  at 
TAB  A.  Tlie  use  of  this  I  iling  system  was  initiated  with  USAAVNC  Pam 

310-4  dated  May  1980. 

b.  The  various  branches  of  DTD  are  currently  in  the  process  of 
building  these  files.  Required  file  categories  currently  or  partially 
developed  include  the  current  copy  of  the  POI,  action  log,  correspondence, 
historical  data,  and  student  critiques.  Categories  not  yet  filled 
inclu<le  worksheets,  annual  review,  instructional  management  data,  test 
outline  and  instructions,  test  summary  sheet,  validation  data,  analysis 
data,  and  evaluation  data.  These  information  voids  should  presently  be 
considered  insignificant.  To  the  extent  that  historical  data  is  complete, 
it  appears  that  tlie  course  has  never  been  subjected  to  a  systematic 
analysis  and  design  program.  Tlie  course  is  scheduled  in  the  DTD  workload 
for  the  current  fiscal  year.  The  completion  of  the  scheduled  ISD  review 
should  generate  appropriate  documentation  to  complete  the  required  file, 
data . 

c.  Hie  void  of  documentation  in  the  analysis  and  design  phases  of 
instructional  development  contrasts  with  the  volume  of  historiial  data 
available  in  Course  Development  Division.  One  possible  inference  from 
this  factor  Is  Chat  the  RWART  course  has  evolved  through  consensus  of 
opinion  and  administrative  action  without  benefit  of  any  instructional 
development  base.  This  statement  is  at  least  partially  supported  by  the 
enclosed  memorandum  by  ETC  Epperson  dated  6  June  1977  (TAB  B) .  Tlie 
source  of  the  problem  is  that  insufficient  resources  are  available  to 
adequately  develop  and  update  all  the  course  of  instruction  at  the 
USAAVNC  institution.  More  effective  utilization  of  our  training  develop¬ 
ment  resources  is  a  subject  area  that  requires  further  research  and 
evaluation.  The  scope  of  such  an  effort  is  beyond  the  purview  of  this 
evaluation  and  will  be  loft  to  other  independent  analyses. 


INSTRUCTIONAL  MATERIALS  AND  EXAMS: 


1 

a.  The  training  materials  for  the  RWARTC  wc're  obtained  from  the 
I'raining  Literature  Management  Branch  and  the  appropriate  inst  rurt  ion.)  1 
departments.  The  course  Program  of  Instruction,  Plight  Training  Supplement, 
Student  Handouts,  Programed  Texts,  .rd  Course  Examinations  wero  reviewed 
for  general  clarity,  objective  consistency,  indications  of  training 
supporting  stated  objectives,  and  indications  that  test  questions  relate 
to  the  training  objectives.  The  training  material  proved  to  be  predominate! 
eonsifUent  and  coordinated,  and  does  support  the  POI  objectives. 

Ii.  The  few  discrepancies  noted  in  the  material  are  as  follows:  The 
stated  course  purpose  is,  "To  provide  aviator  personnel  returning  from 
nonflying  assignments,  with  refresher  training  to  enable  successful 
completion  of  a  UHl  flight  evaluation  and  rotary  wing  instrument  requali¬ 
fication  and  familiarization  of  current  tactical  operations." 

However,  a  memorandum  to  DES  from  the  DT,  now  DOTD,  (TAB  C)  dated  (S  May 
78,  establishes  the  following  policy: 

"The  awarding  or  reissuing  of  a  standard  instrument  rating  is  a 
major  objective,  but  does  not  have  to  be  accomplished.  If  a  student 
does  not  receive  a  standard  instrument  rating  at  least  a  majority  of  the 
training  toward  that  goal  has  been  done  by  us  and  the  training  load  on 
the  new  unit  has  been  reduced  considerably."  (See  TAB  C  for  details  and 
context) . 

A  review  of  sample  data  did  not  disclose  anyone  who  failed  to  instrument 
requalify.  However,  if  this  policy  is  still  effective,  the  potential 
for  major  confusion  exists.  The  separate  nature  of  a  memorandum  renders 
sucli  a  policy  statement  to  increasing  obscurity  and  remoteness  over 
time.  To  eliminate  conflict  and  confusion,  this  policy,  if  confirmed  to 
be  currently  effective,  should  be  included  either  in  the  course  purpose 
or  as  a  POI  note  referenced  to  the  purpose  statement. 

c.  Remaining  discrepancies  noted  consist  of  conflict  between  the 
RWARTC  Program  of  Instruction  (POI)  and  Flight  Training  Supplement 
(FTS). 

(1)  The  POI  purpose  statement  refers  to  instrument  roqual i f 1  cat  ion 
witile  the  FTS  purpose  statement  refers  to  initial  award  or  reestablishment 
of  rotary  wing  instrument  qualification.  While  the  difference  of  intent 
is  minor,  the  potential  for  confusion  does  exist.  The  FTS,  on  page  1-2, 
para  l-4g  states  that,  "An  instrument  flight  examination  may  be  administered 
at  the  end  of  the  Instrument  Flight  Training  Phase  by  a  qualified  instrument 
flight  examiner  in  accordance  with  the  provisions  of  AR  95-1  and  TC  1- 
115.  Wl)ile  the  awarding  or  reestablishing  an  instrument  qualification  Is 
a  major  objective  of  this  course,  instrument  qualification  is  not  a 
mamlatory  requirement  for  course  completion."  This  statement  is  in 
accordance  with  the  stated  memorandum  policy,  but  conflicts  with  llie 
PO I  . 


(2)  Tn  three  Instanees,  the  POI  objectives  lists  tasks  that  ar»' 
not  contained  in  the  Flight  Training  Supplement  list  of  Tasks  Selected 
for  Training  located  on  page  2-2,  para  2-3. 

(a)  The  first  subject  area  is  number  57-9619-35,  UH-IFS. 

The  I’Ol  tasks,  not  in  the  FTS,  are  ATC  procedures.  Transponder,  Instrument 
Departures,  and  Communication  and  Navigation  Failure  Procedures. 

(b)  Linder  subject  area  number  57-9617-15  UH-1  Refresher, 
the  concerned  tasks  are  Decelerations,  Use  of  Auxiliary  Equipment, 

Conlined  Areas,  Pinnacles,  and  Slopes. 

(c)  The  third  subject  area  is  number  57-9616-15  Tactics 
NOE  and  includes  the  tasks  of  Downwind  Operations  and  Hazards  to  Terrain 
Flight.  These  task  discrepancies  should  be  resolved,  so  that  the  Program 
of  Instruction  and  the  Flight  Training  Supplement  will  be  complimentary. 

d.  No  additional  discrepancies  in  the  training  materials  were 
noted . 

6.  USAAVNC  REGUIJLTIONS  AND  DOCUMENTATION  REQUIREMENTS: 

a.  A  search  of  Evaluation  Division  references  was  conducted  to 
determine  what  USAAVNC  regulations  and  pamphlets  would  apply  to  the 
review  of  the  RWARTC.  A  search  of  the  Aviation  Training  Library's  reference 
section  was  completed  to  Insure  completeness  and  currency  of  references 
selected.  The  requirements  established  by  these  regulations  were  reviewed 
to  determine  the  extent  to  which  they  have  been  met. 

b.  The  first  document  covered  is  USAAVNC  Regulation  350-14  dated  6 
June  1979,  Examinations  and  Standards.  This  regulation  states  that 
examinations  will  be  developed  lAW  TRADOC  Pam  350-30  and/or  USAAVNC  Pam 
310-5. 

(1)  Paragraph  3e  of  USAAVNC  Regulation  350-14  refers  to  the 
requirement  for  an  Evaluation  Planning  Information  Sheet  (EPIS)  which  is 
to  be  the  cover  sheet  for  the  test  outline.  No  EPIS  records  were  found 

in  the  course  of  the  evaluation  for  either  the  maintenance  or  the  Instrument 
diagnostic  exams. 

(2)  A  test  outline  format  is  referenced  in  paragraph  3f.  No 
test  outlines  were  discovered  in  the  course  of  the  evaluation. 

(3)  Paragraph  3g  requires  that  each  POI  provide  for  a  comprehensive 
end-of -course  examination  covering  all  terminal  learning  objectives 

(TLO).  The  RWARTC  uses  an  academic  diagnostic  pre-test  for  maintenance 
and  instrument  instruction.  However,  tnere  are  no  provisions  for  a 
comprehensive  end-of-course  examination  for  those  individuals  whose  pre¬ 
test  performance  requires  completion  of  applicable  instruction.  The 
fact  that  all  academic  instruction  in  the  RWARTC  is  self-paced  is  immaterial 
as  paragraph  3a(l)  states  that,  "Examinations  for  self-paced  courses 
will  be  developed  and  included  on  the  same  basis  as  for  other  courses." 


(4)  Paragraph  5c  states  that,  "Instructional  departments  will 
deliver  one  keyed  copy  of  examinations  and  all  masters  used  for  printing 
to  TAn,  DTD.  TAD  will  maintain  a  record  file."  Although  the  inst ructio\iai 
departments  maintained  keyed  copies  of  examinations,  TAD  had  no  documentation 
on  file  for  the  RWARTC. 

(5)  Paragraph  10a  refers  to  the  Management  Information  Systems 
Office  (MISO)  as  being  responsible  for  maintaining  grade  records  for  all 
students.  "A  master  grade  record  will  be  prepared  for  each  student  from 
the  official  class  roster  for  each  class  entering  a  course.  Each  record 
will  identify  the  student  by  course,  name,  social  security  account 
number  and  class,  and  will  include  all  examination  grades  and  course 
averages."  A  printout  of  the  grade  records  for  the  sample  classes  was 
requested  of  and  received  from  MISO.  All  data  categories  were  present 
except  for  student  grades  on  the  academic  diagnostic  examinations  for 
maintenance  and  Instruments.  The  primary  purpose  of  obtaining  the  MISO 
data  printout  was  to  confirm  the  accuracy  of  the  sample  data  extracted 
manually  from  the  historical  flight  records.  When  the  available  data 
from  each  source  were  compared,  numerous  discrepancies  were  noted. 

These  discrepancies  were  resolved  by  reviewing  the  actual  flight  records 
to  reconfirm  the  correct  data.  Of  the  thirty-five  discrepancies  noted, 
five  were  the  result  of  transcription  error  by  the  project  officer  and 
thirty  were  the  result  of  error  somewhere  within  the  data  collection/ 
processing  procedure.  The  records  of  nine  individuals  of  the  thirty-six 
sample  members  had  no  printout  data  available.  This  constitutes  twenty- 
five  percent  of  the  selected  sample.  If  it  is  assumed  that  the  high 
Incidence  of  error,  noted  in  this  case,  is  representative  of  the  available 
data  institution  wide,  then  serious  doubt  is  established  concerning  the 
credibility  of  utilizing  MISO  information  sources  for  managerial  and 
administrative  decision  reference.  — 

(6)  Paragraph  lla  states  that,  "MISO  will  prepare  statistical 
analyses  of  examinations  to  improve  the  quality  of  tests  and  to  obtain 
useful  data  for  improvement  of  training,  ..."  Paragraph  lib  states 

that  "DT  will  provide  TAD,  DTD  with  a  statistical  report  for  each  approved 
examination  in  each  POI."  No  examination  analysis  records  were  discovered 
in  the  course  of  the  evaluation. 

c.  The  second  document  covered  is  USAAVNC  Regulation  350-15  dated 
16  January  1981,  Criterion  Testing.  It  should  be  understood  that  this 
regulation  is  very  recent  and  a  reasonable  amount  of  time  has  not  yet 
passed  to  expect  much  implementation  progress. 

(1)  Paragraph  3a  of  USAAVNC  Regulation  350-15  states  that 
"USAAVNC  POIs"  .  .  .  "over  2  weeks  in  length  will  include  a  Criterion 
Test  (CT)  for  formal  evaluation  of  student  achievement."  The  RWARTC 
course  Itmgth  exceeds  the  two  week  time  frame. 

(2)  Paragraph  5  covers  documentation  and  requires  the  maintenance 

of: 
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(a)  CT  Summary  Sheet  (USAAVNC  Form  809) 


(b)  CT  Outline  (USAAVNC  Form  801) 

(c)  Master  copy  and  solution  sheet  for  each  CT 

(d)  Instructions  for  administration 

(e)  Scoring  and  grading  instructions 

(f)  CT  Analysis  Plan 

The  above  documents  are  to  be  prepared  and  filed  lAW  USAAVNC  Pam  310-4 
using  USAAVNC  Form  606-2.  The  requirements  of  USAAVNC  Pam  310-4  and 
Form  606-2  were  discussed  earlier  under  Historical  Data  and  Course 
Development.  Presently,  none  of  the  above  stated  CT  documents  are 
available  for  the  RWARTC. 

d.  It  is  significant  to  the  evaluation  to  introduce  the  following 
information  concerning  the  grading  system.  In  the  course  of  conducting 
interviews  with  flight  instructors,  the  subject  of  faults  in  the  flight 
grading  system  was  discussed.  The  main  source  of  concern  centers  upon 
the  relationship  between  USAAVNC  Reg  350-16,  the  Uniform  Flight  Grading 
System  (16  Dec  70)  and  the  maneuver  standards  delineated  in  the  Aircrew 
Training  Manual  (ATM).  The  use  of  the  letter  grades  in  accordance  with 
USAAVNC  Reg  350-16  is  defined  in  terms  of  "the  level  of  student  training" 
and  the  "accuracy  of  performance  that  can  be  expected  of  students."  A 
void  exists  in  that  there  is  no  guidance  that  ties  ATM  standards  to  the 
allowances  made  by  instructors  for  "student"  performance  considerations. 
There  is  no  definition  of  the  precision  of  satisfactory  maneuver  execution 
that  qualifies  for  the  assignment  of  an  A,  B,  or  C. 

e.  There  is  no  significant  concern  with  the  flight  grading  system 
in  the  context  that  it  is  a  tool  for  facilitating  student  feedback  or 
motivation.  Normally,  instructor  pilots  start  a  phase  of  instruction 
with  a  concept  of  a  wide  range  of  maneuver  performance  that  will  warrant 
the  award  of  a  satisfactory  grade.  As  the  training  progresses,  the 
range  of  acceptable  maneuver  performance  narrows  at  some  undeterminable, 
variable  rate  to,  ideally,  approach  the  parameters  of  the  ATM  standard 
by  the  end  of  training.  This  variable  rate  of  change  in  acceptable 
maneuver  performance  is  expected  and  varies  among  individual  instructors. 

A  chart  depicting  one  estimate  of  this  phenomenon  is  illustrated  in 
Chart  1. 


PROGRESSION  OF  TRAINING 


ESTIMATE  OF  VARIABLE  FLIGHT  GRADING  PARAMETERS  PHENOMENON 


f.  The  theory  depicted  in  the  chart  is  at  least  partially  supported  by 
a  review  of  student  daily  maneuver  grades  in  any  course.  The  majority  of 
students  will  receive  Bs  for  several  iterations  of  a  maneuver.  This  is  pro¬ 
bably  attributable  to  the  comparatively  large  range  of  acceptable  maneuver 
performance  at  the  initial  stages  of  training.  Also  involved  is  the  factor 
that  many  instructors  use  several  observations  of  student  performance  upon 
which  to  modify  their  individual  rate  of  change  of  acceptable  maneuver  per¬ 
formance.  The  "Average"  student  who  progresses  at  an  acceptable  rate  will 
be  awarded  a  series  of  Bs.  Deviations  from  the  standard  grade  of  B  are  made 
to  reward  superior  performance,  to  indicate  to  the  student  that  he  is  not 
progressing  adequately  or  that  the  student  is  not  meeting  the  instructor's 
expectaf  ions.  Occasionally,  grades  below  B  are  used  to  discourage  unsafe 
habits  or  to  motivate  a  student  who,  although  performing  acceptably,  is 
not,  in  the  instructor's  judgement,  achieving  his  potential  ability  due  to 
an  attitude  problem  or  overconfidence. 

g.  This  application  of  flight  training  and  student  feedback  is  de¬ 
fensible  and  appropriate  in  the  context  of  the  pure  objective  of  developing 
and  maintaining  student  morale  and  confidence  while  progressing  through 
flight  training  in  a  high  pressure  training  environment.  This  application 
also  provides  an  effective  communication  tool  through  which  a  marginal 
student  may  be  clearly  Informed  of  his  situation  and  given  a  reasonable 
opportunity  to  improve  before  administrative  action  is  required. 

h.  Of  concern  to  the  evaluation,  is  that  this  method,  when  used  in 
grading,  affects  accurate  objective  data  collection  and  analysis.  The 
subjective  portion  of  flight  grading  does  not  facilitate  accurate  evaluation 
when  the  resulting  grades  of  student  performance  is  not  measured  in  accor¬ 
dance  with  a  precisely  defined  flight  maneuver  performance  standard  on  a 
dally  basis.  Using  subjectively  derived  flight  grades  to  evaluate  perform¬ 
ance  prevents  objective  evaluation  of  the  effectiveness  of  training. 

i.  Since  there  is  no  guidance  defining  the  breakdown  of  ATM  maneuver 
performance  standards  into  the  precision  required  for  each  satisfactory 
grading  category  (i.e.  A,  B,  and  C) ,  the  individual  instructor  pilot  must 
develop  his  own  criteria  for  awarding  the  various  satisfactory  grades.  The 
individual  instructor  probably  acquires  his  grading  concepts  through  compari¬ 
son  of  personal  concepts  with  the  perceived  standards  of  his  instructor  pilot 
peer  group. 

j .  Problems  are  encountered  when  attempts  arc  made  to  evaluate  the 
adequacy  of  time,  resources,  and  attainment  of  objectives  under  a  given  POI 
based  on  flight  grades.  Tn  examining  adequacy  of  time,  a  standard  or  defined 
decision  rule  is  necessary  in  order  to  determine  the  degree  of  proficiency 
attained.  Using  some  specified  series  of  satisfactory  grades  is  not  preferred 
for  use  as  accurate  objective  data.  When  a  series  of  daily  grades  are  review¬ 
ed  for  a  given  course,  the  series  of  grades  is  likely  to  start  with  several  Bs 
followed,  in  some  cases,  by  occasional  downgrades  toward  the  course  midpoint, 
hopefully  followed  by  gradual  Improvement  until  consistent  As  and  Bs  are  found 


jusL  piior  1(1  the  rheckr i(io .  If  it  is  assumed  that  ATM  standards  are  strictly 
applied,  then  the  first  series  of  satisfactory  grades  In  the  first  days  of  a 
cours(i  would  be  interpreted  as  achievement  of  course  objectives.  The  example 
below  is  tlie  record  of  a  student  (sample  number  eight)  from  an  earlier 


evaluation  of  the  UH-1  MOI  course 
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Again  assuming  uniform  application  of  ATM  standards  for  the  maneuver  - 
autorotat ion  with  turn,  it  should  be  safe  to  assume  that  the  manf'uver  was 
consist ly  mastered  until  training  day  six.  At  training  day  six  it  appears 
that  h'arning  regression  has  occurred  culminating  in  an  unsat  i.,t  actory 
performance . 

NOTE:  The  lack  of  grades  in  the  chart  under  days  eight  to  eleven  does  not 
mean  that  time  elapsed  between  the  last  training  day  and  the  checkridc.  It 
simplv  indicates  the  number  of  training  days  on  which  the  maneuver  was 
practiced , 

The  strict  interpretation  would  be  that  too  much  lime  miglit  bf>  allotted  in 
this  instance  as  competency  was  attained  and  proficiency  declined.  It  is  not 
considered  likely  that  this  is  a  logical  application  of  the  facts. 

k.  Assuming  that  the  grade  patterns  depicted  in  the  chart  arc  fairlv 
common,  it  would  al.so  be  difficult  to  accurately  determine  whether  tlie 
maneuver  training  objective  is  being  performed  to  ATM  standards  or  whether 
reductions  in  training  time  is  having  a  significant  impact  on  training. 
Another  apparent  phenomenon  observed  is  that  IPs  tend  to  sympathize  with  the 
human  dilemma  of  not  enough  time  to  meet  ATM  standards.  Thev  are  often 
unwilling  to  fail  students  who  are  giving  their  all,  are  progr(’ss ing, 
sat  i.sfactor  lly  based  on  perceived  group  norms,  but  are  unable  to  attain  ATM 
standards  in  course  time  allotted.  Admission  to  flight  school  is  a  (halleugi 
and  flight  training  generates  sufficient  pressure  wifhoul  penalizing  the 
students  further  with  unrealistic  time  constraints.  Therefore,  an  informal 
undefined  minimum  "safety"  standard  or  performance  level  expiu  led  of  students 
seems  to  be  applied  in  certain  cases  to  prevent  setback  or  elimination  of 
students  who  are  considered  "average"  or  bettor. 

1  .  In  considering  the  problems  of  the  flight  j'.r.iding  svsti'n,  it  is 
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critiralLy  important  to  realize  that  the  system  serves  two  separate  and  dis¬ 
tinct  functions.  The  function  that  is  of  primary  importance  to  instructors 
and  is  evidenced  on  a  daily  basis,  is  the  student  progress/feedback  -  motiva- 
tion/communication  function.  The  function  that  is  of  relative  insignifi¬ 
cance  to  instructors  is  the  feedback  of  student  performance  information  to 
the  administrative  and  budgetary  departments  of  the  school.  The  Importance 
of  flight  grades  to  the  administrative  decision  process  seems  not  to  be 
correctly  perceived  by  flight  instructors.  An  attempt  to  resolve  the 
flight  grading  situation  is  beyond  the  scope  of  this  evaluation.  The  per¬ 
ceived  impact  of  this  problem  on  the  institution  seems  to  warrant  further 
investigation  and  analysis.  It  is  suggested  that  any  such  study  should 
include  an  attempt  to  derive  a  flight  grading  system  that  will  satisfy  both 
perceived  flight  grading  needs. 

m.  It  is  Interesting  to  note  that  the  evaluator  of  the  RWARTC  found  the 
course  to  be  progressing  well  and  to  be  consistently  meeting  the  course 
objective.  Input  from  developers,  instructors,  and  students  as  well  as  review 
of  course  materials  showed  that  the  POI  purpose  and  objectives  constitute  a 
solid,  effective  course.  As  with  many  other  courses  in  the  school,  several 
areas  exist  where  more  comprehensive  or  additional  Instruction  could  sub¬ 
stantially  improve  the  course.  These  areas,  such  as  Combat  Skills  and  NVG, 
are  those  that  would  equally  qualify  RWARTC  graduates  with  new  lERW  graduates. 
However,  in  consideration  of  time  and  resources  allocated,  the  execution 
of  the  current  program  of  instruction  and  the  attainment  of  course  objectives 
are  being  performed  in  an  excellent  manner.  It  was  not  until  the  course 
was  considered  in  light  of  applicable  regulation  and  pamphlet  requirements 
that  significant  shortcomings  were  discovered.  The  documentary  requirements 
established  seem  designed  to  provide  detailed  Information  for  managers  and 
administrators.  While  the  approach  of  "near  perfect"  availability  of  infor¬ 
mation  for  management  is  certainly  desirable,  consideration  must  be  given  to 
the  degree  of  burdens  and  costs  placed  on  available  resources  administrative 
demands.  The  RWARTC  fails  to  comply  with  a  number  of  regulatory  administra¬ 
tive  requirements,  yet  all  other  evidence  in  this  evaluation  suggests  that 
the  course  is  satisfactorily  fulfilling  the  purpose  for  which  it  was  established. 
Further  research  is  warranted  to  assess  the  utility  of  the  institutional 
administrative  philosophy  and  to  address  the  effectiveness  of  regulatory 
requirements  in  improving  the  Institutional  product. 

7.  STATISTICAL  ANALYSIS: 

a.  Thr  data  obtained  from  the  student  course  records  were  subjected  to 
various  techniques  of  statistical  analysis.  The  academic  and  flight  grades 
were  treated  by  simple  descriptive  techniques  as  contained  in  the  body  of 
this  section.  For  the  purpose  of  analysis,  the  phases  of  flight  instruction 
were  treated  in  the  following  categories;  the  UH-1  Flight  Simulator  (UH-lFS/ 
2B24)  course,  the  Contact  course,  broken  down  by  day  and  night;  and  the 
Tactics  Course.  The  data  for  these  courses  were  arrayed  and  analyzed  by 
means  of  the  Chi-Square  test  and  the  student's  t-test. 
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b.  Table  A  presents  the  mean,  median,  mode,  and  standard  di'viation 
data  for  the  categories  of  instrument  academic  diagnostic,  test  scores; 
instrument  flight  grades.  Instrument  flight  time,  UH-1  Systems  diagnostic 
test  scores,  UH-1  contact  flight  grades,  UH-1  contact  flight  time  and 
UH-1  tactics  refresher  flight  time. 

c.  The  term,  mean,  is  synonymous  with  the  arithmetic  average  and  is 
determined  by  summing  all  the  scores  in  a  set  of  data  and  dividing  by 
the  total  number  of  scores.  The  mean  is  the  measure  of  central  tendency 
that  best  reflects  the  predominance  of  the  scores.  Tlie  symbol  for  tbe 
mean  of  a  sample  is  X.  The  median  is  the  score  above  which  fifty  percent 
of  the  scores  fall.  The  median  is  a  good  measure  of  the  concentration 

of  scores  and  does  not  give  undue  weight  to  a  few  extreme  values.  The 
symbol  for  the  median  is  Mdn.  The  mode  score  best  represents  the  most 
likely  scores  that  will  occur.  For  a  given  set  of  data,  there  may  be 
more  than  one  mode.  The  symbol  for  the  mode  is  Mo.  If  the  distribution 
of  a  given  set  of  data  conforms  exactly  to  the  normal  distribution,  then 
the  values  of  the  mean,  median,  and  mode  will  be  equal. 

d.  The  standard  deviation  is  a  measure  of  variability.  The  standard 
deviation  shows  dispersion  about  the  mean.  The  symbol  for  the  standard 
deviation  for  a  given  set  of  data  is  5,^. 

c.  The  symbol  N  is  used  to  represent  the  number  of  data  items 
ituluded  in  the  computation.  Information  depicting  the  range  of  scores 
for  the  numerical  flight  and  academic  grades  is  included  in  Table  A  to 
provide  a  better  perspective  for  understanding  the  difference  between 
miMti,  mc'dian,  and  modal  scores. 

t.  Charts  2  through  10  display  the  distribution  of  course  time  and 
test  scores  for  all  members  of  the  sample.  These  charts  reference  Table 
A  and  should  be  used  concurrently  to  aid  in  comprehension  of  the  data. 
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Presentation  of  the  Values  of  the  Mean,  Median,  Mode,  and 
Standard  Deviation  by  Training  Course 


Instrument  Academic  Diagnostic  Test  Scores  (See  Chart  2) 


Number  of  Scores  (N) 
Mean  (X) 

Median  (Mdn) 

Mode  (Mo) 

Standard  Deviation  (Sx) 
Range  (of  Scores) 


32 

83 

86 

88 

9.8 

50  to  96 


Instrument  Flight  Grades  (See  Chart  3) 
N  =35 

X  =86 

Mde  =  87 

Mo  (Bi-raodal)  =  85+89 

Sx  =  3.97 


Ranee 


75  to  95 


Instrument  Flight  Time  (POI  times  authorized) 


(12,0)  (See  Chart  4) 


UH-1  (6.5)  (See  Chart  5) 


N  =  21 

X  =  11.98 

Sx  =  0.75 


21 

6,37 

1.66 


UH-1  Systems  Diagnostic  Test  Scores  (See  Chart  6) 


N 

ss 

31 

X 

= 

83 

Mdn 

84 

Mo 

= 

86  +  88 

Sx 

= 

9.57 

Ranee 

_ 

58  to  92 

■  •  ^  . 


UH-1  Contact  Flight  Grades  (Sec  Chart  7) 


SI? 


NOTE:  THE  CHARTS  DEPICTIHG  ACADENIC  TEST  SCORES  AHD  CHECKRIDE  FLIGHT  GRADES  UTILIZE  ALL 
VALUES  OF  THE  SANPLE  GROUP  TO  IHCLUDE  THOSE  WITHOUT  SCORES  IH  ALL  TRAIHIHG  PHASES 
THIS  FACTOR  ACCOUHTS  FOR  THE  DIFFEREHCE  IH  THE  H  VALUE  RETWEEH  FLIGHT  TINE 
CONPUTATIOHS/CHARTS  AND  GRADE  CONFUTATIONS /CHARTS . 


INSTRUMENT  FLIGHT  CHECKRIDE 


INDIVIDUAL  FLIGHT  STUDENTS 


TACTICS  REFRESHER  FLIGHT  HOURS 


UH-1  Tactics  Refresher  Flight  Time  (4.0  hours)  (See  Chart  10) 


N  =21 

X  =  3.24 

=  0.88 

g.  As  preparations  were  made  to  progress  from  descriptive  statistical 
applications  to  the  application  of  an  analytical  approach,  a  potential 
problem  was  identified.  The  original  set  of  data  contained  thirty-six 
sample  members.  However,  not  all  of  the  thirty-six  members  completed  all 
training  phases  or  had  record  data  available  for  each  category.  There¬ 
fore,  to  avoid  distortion  of  the  data  and  analysis,  the  decision  was  made 
to  employ  only  those  sample  members  who  had  complete  sets  of  data  avail¬ 
able.  The  number  of  sets  of  data  meeting  these  criteria  was  twenty-one. 
This  factor  accounts  for  the  different  N  values  in  the  categories 
displayed  in  Table  A,  and  in  the  N  values  in  Charts. 

h.  Table  B  gives  the  breakdown  of  the  flight  time  used  in  each  course 
for  each  of  twenty-one  students  who  completed  all  the  courses.  The 
authorized  syllabus  time  is  Indicated  in  parenthesis  below  each  heading. 


For  tV>e  UH-IFS  phase,  fifteen  (15)  students  completed  in  exactly  the  autho¬ 
rized  time  of  twelve  (12)  hours  and  four  (4)  completed  in  less  time.  For 
the  aircraft  phase,  one  student  finished  in  the  authorized  time  of  six  and 
one-lialf  (6.5)  hours  and  eleven  finished  in  less  time.  A  reduction  of  time 
was  also  realized  for  day  flight  with  sixteen  (16)  students  completing  in 
under  the  authorized  six  (6)  hours.  Only  one  student  took  more  than  the 
syllabus  time  of  one  and  one- half  (1.5)  hours  for  the  night  course  and  every¬ 
one  completed  the  tactics  at  or  under  the  authorized  time  of  four  (4)  hours. 

i.  Tabic  C  summarizes  the  mean  and  standard  deviation  for  each  of  the 
flight  phases  within  the  refresher  training  program. 


TABLE  C 

MEANS  AND  STANDARD  DEVIATIONS  IN  HOURS  BY  COURSE 


UH-IFS 

AC 

DAY 

NIGHT 

TACTICS 

11.98 

6.37 

5.31 

1.08 

3.24 

0.75 

1.66 

0.  98 

0.25 

0.88 

Two  questions  are  addressed  with  these  data.  First,  are  the  frequencies  ob¬ 
served  in  Table  B  different  from  those  expected  in  a  normal  distribution? 

The  assumption  is  that  the  amount  of  time  authorized  in  the  syllabus  is  a 
reasonable  estimate  of  the  average  time  it  would  take  experienced  aviators 
to  complete  refresher  training.  A  further  assumption  is  that  the  time-to- 
i-omplet**  for  all  such  aviators  is  approximately  a  normal  probability  distri¬ 
bution.  Under  this  second  assumption,  one  would  expect  to  find  two-thirds  of 
all  aviators  completing  the  course  within  a  range  one  standard  deviation  above 
the  mean  to  one  standard  deviation  below  the  mean.  For  a  group  of  twenty-one 
(21)  aviators  one  would  then  expect  to  find  approximately  fourteen  (14)  in 
this  range  and  the  remaining  seven  (7)  divided  above  and  below  these  limits. 

j .  Table  D  gives  the  distribution  of  frequencies  from  the  data  in  this 
report  for  the  three  corresponding  groups;  those  whose  time  was  greater  than 
one  standard  deviation  above  the  mean,  those  whose  time  was  between  one  stan¬ 
dard  deviation  above  and  one  standard  deviation  below  tlie  man,  and  those 
whose  time  was  less  than  one  standard  deviation  below  the  mean. 


TABLE  D 

ACTUAL  FREQUENCY  DISTRIBUTION  OF  TIMES  BY  COURSE 


A 

B 

C 

t<X-lS 

XlS^t<X+lS 

X+lS^t 

F 

F 

F 

UH-IFS 

2 

17 

2 

AC 

3 

15 

3 

Day 

4 

12 

5 

Night 

1 

18 

2 

Tactics 

3 

18 

0 

A  =  Time  less  than  one  standard  deviation  below  the  mean 

B  =  Time  between  one  standard  deviation  below  the  mean  and  one  standard 
deviation  above  the  mean 

C  =  Time  greater  than  one  standard  deviation  above  the  mean 

Table  D  shows  that  the  majority  of  aviators  completed  each  course  in  the 
time  interval  between  plus  and  minus  one  standard  deviation. 

k.  A  Chi-Square  test  was  used  to  test  the  distribution  given  in 
Table  D  for  normality.  Table  E  gives  the  results  of  the  Chi-Square 
tests. 

TABLE  E 

CHI-SQUARE  VALUES  BY  COURSE 

IIH-IFS  AC  DAY  NIGHT  TACTICS 


dl 


2 


A  Chi-Sqiinro  value  of  5.99  or  more  is  statistically  significant.  Since 
none  of  these  values  indicate  a  statistically  significant  difference 
between  the  expected  distribution  of  frequencies  and  the  actual  fre¬ 
quencies,  the  normal  distribution  may  be  used  as  a  basis  for  the  further 
analysis . 

l.  The  second  test  was  applied  to  determine  if  the  average  time 
obtained  for  any  course  was  significantly  different  from  the  authorized 
Lime.  The  logic  of  the  test  is  as  follows;  Assume  that  there  is  some 
variability  in  the  actual  data  which  results  from  a  variety  of  factors 
other  tlian  the  proficiency  of  the  aviators.  Further  assume  that  these 
variations  are,  on  the  average,  about  equally  positive  and  negative  in 
their  effects  over  all  possible  sets  of  times  that  might  have  been 
examined.  Under  these  assumptions,  it  is  reasonable  to  expect  that,  in 
general,  the  observed  average  time  will  not  be  exactly  equal  to  the 
authorized  syllabus  time,  but  will  differ  from  the  authorized  time  by 
some  acceptably  small  amount.  If  the  standard  deviation  is  used  as  a 
measure  of  this  variation,  it  is  possible  to  use  the  normal  probability 
distribution  to  determine  the  likelihood  that  the  difference  between  the 
authorized  and  observed  times  is  within  a  predetermined  small  amount. 

F<'r  this  analysis,  a  test  value  was  selected  so  that  in  no  more  than 
five  out  of  one  hundred  times,  an  insignificant  difference  will  be  said 
to  be  significant. 

m.  In  the  first  test  it  was  shown  that  the  observed  times  for  each 
coursi'  form  distributions  that  are  approximately  normal.  Also  since  the 
author  i, III  time  for  eacli  course  can  be  expected  to  be  the  average  time 
for  .in  .ivlator  to  complete  tiic  course,  a  calculated  value  which  is 

greater  than  +2.09  or  less  than  -2.09  is  said  to  be  statistically  significant. 
Table  F  gives  the  calculated  values  for  each  course. 

TABLE  F 

t  -  Scores  by  Course 

INSTRUMENTS  UH-1  VFR 

MH- ll’S  Aircraft  Day  Night  T.ictics 

-O.n  -0.  36  -3.23  -7.70  -3.96 


AM  oi  Lhise  values  are  negative  since  the  average  time  taken  to  complete 
(■  icli  .  oiirsi-  w.is  less  than  the  authorized  time.  Since  they  are  less  than 
-.’.00,  I  iiose  values  for  Day,  Night,  and  Tactics  are  statistically  signifi- 
I  ant .  Mure  the  average  times  to  complete  these  three  classes  arc  only 
K'.ss  th.in  the  authorized  times  by  approximately  twenty-five  minutes  for 
Niglit  .ind  forty-five  minutes  for  Tactics,  the  practical  significance  of 
liiesf  dilferences  is  minimal. 
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COllUSl'  CRITIQUES  AND  INTERVIEWS: 


n.  A  review  of  student  critiques  was  conducted  to  identify  trends 
and  .  ommon  comments  and  recommendations.  A  total  of  one  hundred  and  ten 
critiques  were  reviewed.  Of  these  one  hundred  and  ten,  sixty-three 
contained  written  comments.  The  critiques  available  did  not  correspond 
to  the  sample  classes.  The  procedure  followed  was  to  review  all  of  the 
critiques  currently  available  at  DTD,  CDD.  The  vast  majority  of  the 
critique  questions  were  answered  in  Column  A  (Agree).  The  number  of 
Column  B  (Disagree)  and  Column  C  (No  Comment)  answers  were  insignificant. 

An  example  of  the  critique  format  is  found  at  TAB  D. 

b.  The  comments  on  the  critiques  were  arranged  under  seven  common 
areas.  (The  frequency  of  each  comment  subject  area  is  illustrated  in 
Chart  11.  The  percentage  frequency  value  for  each  subject  area  is  also 
stated  below.) 

(1)  Forty-six  percent  (46%)  of  those  students  submitting  written 
comments  made  highly  complimentary  statements  concerning  the  professionalism 
dedication,  and  the  positive  attitudes  of  the  instructor  pilots. 

(2)  TVenty-one  percent  (21%)  of  the  critiques  contained  the 
comment  that  more  time  is  needed  in  the  course  to  address  tactics, 
combat  skills,  and  night  vision  goggle  training. 

(3)  Eleven  percent  (11%)  of  the  sample  stated  that  more  Lactical 
instrument  training  is  needed.  However,  sixteen  percent  (16%),  not 
necessarily  inclusive  of  the  prior  stated  eleven  percent,  observed  that 
tactical  Instrument  doctrine  is  unsound  and  unrealistic. 

(4)  Eight  percent  (8%)  of  those  commenting  stated  that  being 

too  frequently  assigned  a  "guest"  instructor  pilot  disrupted  the  continuity 
of  their  refresher  training.  A  "guest"  instructor  pilot  is  an  instructor 
other  than  the  originally  assigned  instructor  who  flies  with  a  given 
student  for  administrative  reasons.  This  term  does  not  include  the 
event  of  a  formal  change  of  flight  instructor.  The  rate  of  utilization 
of  guest  IPs  is  depicted  in  Chart  12.  The  percentage  of  students  in  the 
sample  having  at  least  one  guest  IP  amounted  to  eighty-six  percent 
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('>)  I'oiirteen  percent  (14%)  of  the  students  commented  that  a 
proc.  d'.irr  dioulJ  be  es t ah  1  i shed  to  afford  assigned  students  the  opportunity 
to  aiquir''  the  RWARTC  training  materials  prior  to  arriving  at  Fort  Rucker. 
These  inilivuluals  generally  commented  that  too  much  material  was  covered 
in  too  short  i  time  period  and  that  prior  access  to  the  training  material 
wiuild  have  greatly  increased  the  effectiveness  of  the  course  of  instruction. 

(b)  I'wenty-f our  percent  (24%)  of  the  critique  comments  referred 
to  tin  2(^5  Cockpit  Procedural  Training  device  as  being  a  highly  effective 
and  valuable  instructional  tool.  Many  comments  lauded  the  device  for  en¬ 
abling  tliem  to  visuali/e  and  comprehend  the  various  aircraft  operational 
and  emcrc.ency  procedures.  All  of  these  individuals  included  statements 
commending  the  dedication,  effectiveness,  and  professionalism  of  the 
2Cj5  instructor. 

The  remaining  ungrouped  comments  were  predominately  referenced  to  personal 
cotiflicts  and  individual  problems  that  do  not  affect  the  substance  of  the 
RWARTC . 

c.  Informal  interviews  were  conducted  with  the  Rotary  Wing  Instrument 
Brandi  (RWIB)  Commander  and  four  Rotary  Wing  Aviator  Refresher  Training 
Course  (RWARTC)  instructor  pilots. 

d.  The  consensus  was  that  the  training  is  being  accomplished  to  the 
best  degree  possible  in  consideration  of  present  objectives  and  time  and 
personnel  available.  The  personnel  unanimously  agreed  that  additional 
time  would  be  useful  in  providing  more  comprehensive  proficiency  training. 

e.  I'ho  primary  difficulty  encountered  in  the  training  program  is 
generated  by  a  significant  problem  in  assigned  instructor  pilots.  The 
problem  concerns  the  management  of  instructor/student  assignments  in 
consideration  of  the  fact  that  not  all  instructor  pilots  are  qualified 

in  contact,  instrument  flight  instruction,  instrument  flight  examination, 
and  tactics.  A  variety  of  circumstances  cause  a  relatively  large  numer 
of  guest  instructor  pilot  assignments.  The  large  number  of  guest  IP 
assignments  was  noted  as  a  potential  problem  in  both  the  data  assembly 
process  and  the  review  of  student  critiques.  The  use  of  guest  TPs  was 
acknowJ  ('dged  as  undesirable  due  to  the  subsequent  disruption  of  the 
developing  instrnrtor/stndent  rapport.  However,  due  to  management/ 
administrative  considerations,  the  situation  is  unavoidable. 

f.  Some  contact  instructors  are  not  instrument  instructors,  thereby 
necessitating  an  IP  change  as  the  student  moves  into  instrument  training. 
Some  instrument  instructors  are  grounded  and  restricted  to  2B24  flight 
simulator  training,  causing  another  instructor  to  be  required  for 
training,  in  the  actual  UH- 1 11  aircraft.  Not  all  instrument  instructors 
are  examiners,  thereby  causing,  the  use  of  g,nest  IPs  c'  '  xaMiiiK'r;;  to 
administer  checkrides.  Some  libs  are  not  qualified  as  tactics  i  ns  1 1  iic  t  ors , 
thus  ref|uiring  IP  cli.inges  for  tactics  refresher  training.  This  situation 
is  further  compounded  bv  the  requirement  to  send  currently  assigned 
instructors  to  tlie  instrument  flight  instructors  and  examiners  courses 

as  shortfalls  in  these  classes  become  available.  At  the  time  of  the 
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i iiterv  i  I'w.s ,  the  RWARTC  had  thirty-one  Instructors  assigned.  Of  these, 
twelve  instructors  needed  qualification  as  instrument  instructors  and 
light  additional  Instructors  needed  qualification  as  instrument  examiners. 

ICach  of  the  subject  training  courses  lasts  approximately  six  weeks  and 
shortfall  admissions  to  these  classes  are  comparatively  infrequent. 

Therefore,  the  time  period  required  to  bring  the  assigned  Instructors  to 
a  high  percentage  of  full  qualification  will  be  lengthy.  Periodically, 
fully  trained  instructors  are  transferred  to  other  branches,  primarily 
IF.RW,  and  are  often  replaced  with  Instructors  without  qualif icat ions  in 
all  pertinent  areas.  Permanent  change  of  station  transfers  arc  also  a 
factor.  I'hese  factors  in  combination  create  a  continual  turnover  that 
generates  a  perpetual  instructor  training  requirement.  Therefore,  the 
necessity  to  utilize  frequent  guest  instructor  pilots  and  instructor 
pilot  changes,  although  undesirable,  is  presently  unavoidable. 

g.  Two  other  problem  areas  were  brought  up  during  the  interviews. 

The  first  difficulty  concerns  the  increasing  aircraft  density  as  the 
volume  of  Initial  Entry  Rotary  Wing  (lERW)  students  entering  Che  training 
program  increases.  lERW  instrument  instruction  takes  precedence  over 
otlier  peripheral  courses  at  Che  institution  for  use  of  close-in  instrument 
enroute  structures  and  training  facilities.  The  additional  time  required 
to  reach  ti\e  outlying  facilities  decreases  the  amount  of  effective 
training  time  available.  Increases  in  the  density  of  air  traffic  causes 
an  increase  in  mean  times  between  approaches.  This  further  reduces  the 
pro<Iuc  t  Iv  i  t  y  of  flight  time. 

h.  All  additional  problem,  also  related  to  increasing  lERW  course 
input,  is  the  availability  of  SFTS  training  periods.  Current  scheduling 
dictates  frequent  use  of  Che  Echo  (E)  SFTS  scheduling  period.  As  course 
loads  increase,  there  may  be  a  necessity  to  resort  to  exclusive  use  of 

E  period  or  perhaps  even  the  establishment  of  a  Foxtrot  (F)  SFTS  scheduling 
period.  There  is  concern  by  course  incumbents  that  such  an  event  may 
cause  course  flow  and  crew  rest  problems. 

9.  COMBAT  AVIATOR  REFRESHER  COURSE: 

a.  At  the  time  of  this  evaluation.  Course  Development  Division 
(CDD),  was  in  the  process  of  preparing  a  proposed  change  to  the  RWARTC 
that  would  create  a  Combat  Aviator  Refresher  Training  Course  (CARTC) . 

The  proposed  change  will  accept,  as  students,  those  aviators  who  have 
been  in  a  nonflying  assignment  for  at  least  18  months  or  wlio  have  been 
in  a  fixed  wing  assignment  and  receive  orders  to  a  rotary  wing  assignment. 

Ihe  |)]  aimed  training  would  prepare  these  aviators  to  be  able  to  successfully 
complete  a  UH- 1  flight  evaluation,  a  rotary  wing  instrument  requalification, 
and  refresher/qualification  in  current  tactical  operations  (Nap  of  the 
Earth,  Eight  Hawk,  and  Night  Vision  Goggles).  In  Che  planning  sequence 
of  this  evaluation,  a  request  was  received  to  include  an  informal  circulation/n 
of  the  proposed  CARTC.  The  inclusion  of  this  topic  is  not  to  be  considered 
an  evalu.ition  item. 
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h.  Tlie  basic  purpose  of  the  change  is  to  provide  aviators  returning 
to  aviation  assignments  with  the  same  training  qualifications  as  a  new 
graduate  of  the  Initial  Entry  Rotary  Wing  Aviators  Course.  The  RWARTC, 
as  it  is  now,  is  not  sufficiently  training  commanders  and  key  unit 
per'ionnel  returning  from  nonflying  assignments.  Tliey  are  less  educated 
and  (luilified  in  current  aviation  doctrine  and  flying  skills  than  the 
new  aviators  under  their  diret tion  and  leadership.  The  proposed  change 
is  designed  to  remedy  this  undesirable  situation  that  has  occurred 
tlirougti  changes,  over  time,  in  the  content  of  lERW  training. 

c.  Ttie  proposed  change  would  divide  the  course  into  two  phases  and 
lengttien  the  course  from  the  present  four  week  duration  to  a  total  of 
nine  weeks  and  one  day  for  peacetime.  Phase  I  would  cover  four  weeks 
.and  tliree  days  and  include:  the  course  overview,  cockpit  procedures, 
aircraft  systems  familiarization,  aviation  life  support  equipment  (ALSE) , 
and  visual  and  instrument  flight  training.  Phase  IT  would  also  cover 
four  weeks  and  three  days  and  would  include:  basic  combat  skills  academic 
training,  night  academics,  night  terrain  interpretation,  combat  skills 
flight  training  (NOE/NH/NVG)  and  the  course  critique.  Further  details 

of  the  proposed  change  can  be  found  under  TAB  B.  NOTE:  It  is  to  be 
advised  that  the  proposal,  a  working  document  at  the  time  it  was  acquired, 
had  not  been  formally  staffed.  The  POI  proposal  was  obtained  from  CDD 
and  informally  circulated  among  RWARTC  incumbents  to  provide  informal 
feedback  to  assist  in  POI  refinement.  Their  responses  have  been  collated 
•ind  included  in  the  evaluation  report  to  informally  assist  in  the  refine¬ 
ment  of  the  proposal  and  to  point  out  potential  problems  with  the  proposal 

d.  All  parties  agreed  that  having  aviators  return  to  rotary  wing 
night  assignments,  qualified  in  the  same  knowledges  and  skills  as  new 
lERW  graduates,  is  a  desirable  objective.  However,  the  availability  of 
resources  to  accomplish  the  objective  and  concern  for  certain  specific 
aspects  of  the  proposal  are  causing  reservations  toward  implementation. 

The  major  problems  cited  by  the  respondents,  and  their  comments,  are 
aiklressed  below. 

(1)  AR  95-1,  paragraph  2- If  requires  an  aviator  to  receive 
flight  refresher  training  after  being  prohibited  or  excused  from  flying 
duties  for  six  months  or  longer.  The  regulation  does  not  stipulate 
whether  the  training  is  to  be  institutional  or  unit.  One  interpretation 
is  that  the  unit  is  responsible  for  refresher  training  for  those  having 
lietween  six  and  eighteen  months  of  nonflying  time.  A  question  here  is 
whether  or  not  this  factor  affects  the  assignment  policy  goal  for  institu¬ 
tionally  administering  "refreslier  training"  as  opposed  to  lERW  policy 
goals  and  the  difference,  if  any,  in  the  skills  acquired  through  each 
and  the  level  of  proficiency  of  both  products.  A  policy  decision  is 
needed  to  determine  how  all  aviators  who  are  not  qualified  in  all  current 
lERW  subjects  and  who  have  been  in  nonflying  jobs  will  be  brought  up  to 
date  in  aviation  doctrine  and  skills.  Guidance  is  also  needed  to  identify 
which  skills  are  appropriate  for  institutional  versus  unit  training. 
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(2)  'I'hf  proposed  oourse  is  evolving  despite  ;in  unclear  overall 
objective*.  For  exumpLo,  it  is  not  clear  as  to  whether  the  course  is  a 
"refreslier"  course  or  a  "qualification  course".  Trying  to  include  both 
purposes  in  one  course  generates  numerous  potential  problems.  An  aviator 
may  not  be  able  to  complete  a  phase  in  the  allotted  time.  Individuals 

who  have  never  held  an  initial  instrument  rating  are  being  taught  refresher; 
or  is  it  qualification?  The  scope  of  the  POI  refers  to  refresher/qualifica¬ 
tion  training  in  conjunction  with  tactical  operations,  yet  it  is  not 
stated  whether  or  not  a  tactics  checkride  is  required. 

(3)  In  the  POI  course  summary,  several  potential  conflicts  were 

no  r  I'd . 


(a)  Dual  flight  time  allotted  to  prepare  for  the  contact 
chcckride  is  4.5  iiours.  This  amount  of  time  is  not  sufficient  to  train 
the  Jist  of  tasks  to  ATM  proficiency.  It  is  estimated  that  at  least 
thri'e  more  flight  training  periods  would  be  required  to  meet  the  training 
objectives . 


(b)  Academic  hours  devoted  to  the  2C35  and  aircraft  systems 
familiarization  number,  collectively,  25  hours.  To  be  of  any  significant 
value  to  the  flight  line  training,  consideration  should  be  given  to  this 
instruction  being  front- loaded  as  well  as  concurrent.  It  is  realized 
that  the  other  half-day  from  training  already  supports  three  hours  of 
classroom  time. 


(c)  ALSE  training  (6.0)  would  be  of  more  value  accompanying 
those  hours  associated  with  tactical  training. 

(d)  To  support  a  qualification  program  of  tactics,  six 
"Refreslier  Hours"  might  bo  inadequate.  The  Rotary  Wing  Instrument 
Brandi  lias  no  practical  current  experience  in  conducting  a  tactics 
qualification  program, 

(e)  instrument  flight  training  is  predicated  totally  in 
the  flj>;ht  simulator.  According  to  AR  95-i,  not  all  personnel  can 
receive  an  instrument  rating  in  the  simulator.  This  goes  back  to  the 
course  [irerequlsites .  There  are  still  people  who  hold  no  prior  ratings 
in  instruments.  Again,  instrument  academics  should  be  flowed  to  align  or 
precede  actual  flight  training.  Possible  saturation  of  available  SFTS 
time  should  be  considered.  Currently,  with  the  four  scheduled  classes, 
tliere  is  only  a  two  day  overlap  in  scheduling.  The  program  change  will 
have  a  significant  overlap  and  may  require  more  cockpits  than  are  now 
aval  1 ab 1 e . 


(f)  One  section  of  emergency  tasks  arc  instructed  in  the 
"2C33  only".  If  these  are  considered  checkride  items,  how  will  they  be 
evaluat'd?  H.is  the  possibility  of  turnbacks  been  considered?  Currently, 
7.015  train  in;;,  is  conducted  at  nig.lit  due  to  congestion.  Concern  viias 
expres:.'  d  (hat  it  will  be  dif  ficult  to  plan  the  course  flow  in  a  in, inner 
tliat  will  meet  realistic  time  and  course  length  lonsL  ra  i  nts . 

e.  file  POI  commentary  predominately  centers  on  two  issues.  The 
first  'oncerns  a  trend  toward  confusion  between  the  "refresher"  and 
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"<iualit  ication"  aspects  of  the  course  and  how  those  concerned  personnel 
will  qualify  for  the  aviation  "update"  program.  The  second  Involves 
resource  and  time  concerns  that  are  always  offered  as  a  major  factor  in 
determining  the  feasibility  of  expanding  training  at  the  institutional 
level.  The  intent  of  the  CARTC  proposal  is,  at  least  partially,  supported 
by  consensus  of  opinion,  student  course  critiques,  and  feedback  from 
RWARTC  graduates  in  the  Aviation  Center  Training  Analysis  and  Assistance 
Team  (ACTAAT)  reports.  Again,  the  intent  of  this  portion  of  the  evaluation 
is  to  provide  informal  feedback  to  the  course  developers  to  point  out 
problem  areas  and  to  facilitate  refinement  of  the  forthcoming  POI  change 
proposal  for  the  RWARTC. 


SUMMARY  OF  FINDINGS 


1.  The  dnta  extracted  from  the  student  flight  records  did  not  precisely 
match  the  printout  data  obtained  from  MISO  for  the  subject  sample  classes 
80-19  through  80-28.  Thirty-five  discrepancies  were  identified.  Of 
those,  live  were  errors  made  by  the  project  officer  and  thirty  were  made 
somewhere  within  the  data  collection/processing  procedure.  Nine  of  the 
thirty-six  sample  members  had  no  printout  data  available. 

2.  Due  to  consistently  low  priority  assessment,  the  Rotary  Wing  Aviator 
Kef  tosher  I'raining  Course  has  never  been  developed  or  reviewed  in  accordance 
with  the  principles  of  Instructional  Systems  Development.  A  task  analysis 
of  tile  course  is  presently  scheduled  to  commence  in  the  third  quarter  of 
fiscal  year  1981. 

3.  Historical  and  course  development  records  and  materials  do  not 
comply  with  certain  requirements  of  USAAVNC  Regulation  350-14  Training 
F.xamina tions  and  Standards,  USAAVNC  Regulation  350-15  Criterion  Referenced 
Examinations,  and  USAAVNC  Pamphlet  310-4  Preparation  and  Use  of  Lesson 
Plans  and  Instructor  Guides.  The  majority  of  the  discrepancies  are 
attributable  to  the  recent  effective  date  of  many  requirements  and  to 

the  fart  that  ISD  principles  have  yet  to  be  applied  to  the  course. 

Sperlfic  discrepancy  items  are  noted  in  the  body  of  the  report. 

4.  With  the  exception  of  compliance  with  administrative  guidelines,  the 
course  material  is  predominately  well  coordinated  and  complimentary. 

The  course  objectives  are  being  supported  and  achieved.  The  students 
are  predominately  pleased  with  all  aspects  of  the  course.  The  RWARTC  is 
currently  fulfilling  the  purpose  and  objectives  established  in  the  POI 
in  an  excellent  manner. 

5.  The  relation  of  the  ATM  to  maneuver  standards  and  flight  grading  has 
been  identified  as  a  serious  problem  pervading  the  entire  institution. 

The  problem  centers  in  the  method  of  strict  application  of  the  ATM 
standards  to  student  flight  training  and  the  use  of  the  resultant  grades 
as  feedback  information  for  institutional  management,  funding,  and 
evaluation  of  effectiveness. 

6.  Statistical  analysis  of  course  data  indicates  a  well  managed  course 
with  acceptable  statistical  deviation  from  established  objective  performance 
goals.  In  those  cases  in  which  statistically  significant  deviation  was 
(.'stabl  ished ,  an  examination  of  actual  time  deviations  revealed  a  realistic 
difference  that  is  inconsequential. 

7.  A  review  of  course  critiques  indicated  that  the  vast  majority  of 
students  feel  the  course  is  excellent  and  of  benefit  to  them.  Numerous 
comments  lauded  the  instructor  pilots  and  2C35  instructors  as  being 
outstanding  trainers  wiio  were  higlily  professional.  The  only  other  major 
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coimncnt  was  that  more  time  should  be  made  available  for  tactics  and 
night  vision  goggle  related  training. 

8.  Problem  areas  within  the  course,  as  perceived  by  instructors  and 
cour^i'  management  personnel,  are  insufficient  personnel,  time,  and 
resources,  increasing  lERW  student  input  causing  less  available  resources 
and  less  access  to  more  convenient  training  facilities,  and  the  fact 
that  RWARTC  graduates  (future  commanders  and  instructor  pilots)  lack 
certain  skills  acquired  by  lERW  graduates. 

9.  Tlie  CARTC  review  was  completed  as  an  information/feedback  endeavor 
separate  from  the  primary  Intent  of  the  evaluation.  Personnel  associated 
with  the  CARTC  agree  that  key  unit  personnel  and  more  experienced  aviators 
should  have  the  same  knowledges  and  skills  of  current  aviation  doctrine 

as  recent  lERW  graduates.  This  factor  is  at  least  partially  supported 
by  student  course  critiques  and  feedback  from  the  Aviation  Center  Training 
Analysis  and  Assistance  team  visits.  However,  there  is  concern  and 
confusion  concerning  whether  the  course  is  a  "refresher"  or  a  "qualifica¬ 
tion"  course,  how  these  apparently  conflicting  purposes  integrate,  and 
whether  institutional  facilities  and  resources  can  support  such  a  program. 

10.  RECOMMENDATIONS; 

a.  Information  for  the  RWARTC  obtained  from  MISO  contained  a  relatively 
large  number  of  errors  when  compared  to  the  flight  records  on  file  at 

DOAT.  I'hf  fact  that  data  was  missing  for  several  sample  members  increases 
the-  cause  for  concern.  It  is  recommended  that  the  data  collection  and 
processing  procedure  be  reviewed  to  determine  the  cause  of  the  errors  in 
the  system,  and  to  determine  how  widespread  the  error  rate  is  within  the 
management  information  system.  (MISO  proponency) 

b.  The  RWARTC  is  of  such  low  priority  that  it  has  never  benefited 
from  the  ISD  procedure.  This  suggests  that  DTD  might  have  insufficient 
personnel  resources  to  adequately  support  the  current  developmental 
course  load.  It  is  recommended  that  a  study  be  conducted  to  determine 

if  the  most  effective  utility  is  being  gained  from  current  course  development 
resource  distribution,  or  if  more  efficient  resource  utilization  alternatives 
are  available.  (DTD  proponency) 

t-.  It  is  recommended  that  all  parties  to  the  RWARTC  be  reminded  of 
the  regulatory  requirements  of  USAAVNC  Reg  350-14,  350-15,  and  USAAVNC 
Pam  350-4  to  insure  continued  progression  toward  fulfilling  documentary 
requirements.  Also,  the  utility  of  each  documentation  requirement  should 
be  assessed  to  insure  that  only  minimum  essential  management  documentation 
is  generated.  (DTD  and  DOTD  proponency) 

d.  The  current  flight  grading  system  is  adequate  to  fulfill  instructor/ 
student  feedback  needs,  but  fails  to  provide  meaningful  ATM  standards 
proficiency  progression  information  to  enable  quantitative  assessment  of 
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t  t  .1  i  I)  i  II)',  iii-t'diil  lor  iiisL  i  Lutitm.i  1  maiiagfincMit .  Lt  Is  i  ocommoiKlcd  Ih.il 
ellorts  be  initiated  to  modify  the  flight  grading  system  to  satisfy  both 
functions  of  the  system.  (DTD  proponency) 

11.  CONCLUSION:  The  RWARTC  is  accomplishing  the  current  course  objective 
in  an  outstanding  manner.  The  personnel  associated  with  the  course  are 
liighlv  professional  and  are  motivated  to  insure  that  the  students  achieve 
maximum  benefit.  The  course  could  be  more  comprehensive  in  scope,  and 
plans  are  under  way  to  submit  such  a  proposal.  The  planned  ISD  review 
of  the  course  development  should  serve  to  fill  the  lack  of  regulatory 
documentation  and  may  provide  further  evidence  for  the  need  for  expanding 
the  training  as  outlined  in  the  CARTC  proposal.  The  RWARTC  is  a  very 
valuable  course  for  the  personnel  returning  to  aviation  assignments. 

The  efforts  of  all  personnel  involved  are  commendable. 


V  xioNadJV 
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C  PARTMENT  OF  THE  ARMY 

HFADOUARTERS  UNITtL'  STATES  ARMY  AVIATION  (  INTER  ANn  I  OUT  RUCKER 
FORI  RUCKER  ALABAMA  ^6362 


ATZQ-TD-CI>-IT 


6  June  197/ 


MEMORANDUM  FOR:  DEPUTY  DIRECTOR  OF  TRAINING  DEVELOPMENTS 
SUBJECT:  Aviator  Refresher  Training  Course 


1.  Reference  is  made  to  the  DCG*s  inquiry  and  DTD's  response.  (Incl  1) 

2.  To  prepare  additional  self-paced  materials  for  the  course,  it  would 
be  nice  for  our  training  support  writers  to  be  provided  with  a  course 
design  and  training  objectives.  In  the  past,  the  training  analysis  and 
design  work  has  not  been  accomplished  or  partially  completed  by  Institutional 
Training  Branch  as  well  as  their  assigned  task  of  Phase  III,  Course  Develop¬ 
ment.  This  procedure  combined  with  inadequate  staffing  has  resulted  in 

the  development  of  new  courses  made  up  of  lesson  plans  from  existing  courses. 
The  end  result  being  a  course  which  is  not  specifically  designed  for  the 
type  student  attending  it.  A  good  example  is  the  Commander's  Readiness 
Course,  wherein  lERW  lesson  material  has  been  presented  to  senior  officers. 

3.  Request  if  at  all  possible,  that  tasking  for  this  project  include 
Training  Analysis  and  Design  as  a  first  step  to  identify  the  training  tasks, 
course  design  and  objectives  prior  to  Course  Development  writing  the  lesson 
plans  to  support  this  instruction. 


1  Incl 
as 


/ 

/(y 

THEO  S.  EPPERSON 
LTC,  IN 


Chief,  Course  Development 


Division 


APPENDIX  B 


ATr.Q-T-TM  1S?3 

hEMOPA'iDU’!  FOr.t  DIRECTOR  0?  EV'IUATION  /^fD  STA'ID'ETIZATIOM 
SUBJECT:  H-JART 


1.  This  ai2-'’.L'rari<li-.n  Is  In  reply  to  your  r.erior.’.ndun  of  21  !Iarch  concerning 
wJvet'icr  or  not  .•'.n  Ir.stmnciit  rctinr  nust  be  n-jardcl/reisrue-J  In  K'-IAET  for 
a  stocant  to  be  cenoitiered  a  grad”/at^. 

2.  TViO  pumor.c  ol  tlie  refronhur  courao  er,  stated  in  f-ourse  of  Inntructlcn 

(COI)  2C-T'31,  dated  ’■'arch  1S*?6  lo  to  provide  avintor  personnel  returning  fron 
ncrnflyinf>  flc;;irron£iitc ,  wltli  refresher  trnir.inc  to  enrhlc  siicc'isaful  cor.— 
ple-tlciu  of  s  UH-l  evnluntion  tfr.d  rot.nrv  winp.  Instrar'onc  reqenllf  1  cntlcn 

and  t r Tlliorl-atlcn  of  current  tactical  opnrctic-.is.  'UnJer  nn  Infomnl  a~ree- 
irent  bct’-'ccn  ?;n,ior  Cnncral  Srilth  end  n'ysoif  the  ranior  cr-phasis  In  this  cciirne 
In  pL'.ccd  on  t'nc  recuclifyinf;  of  tht  Inr.truncnt  ratlny,.  Tl’.e  /u'ardJns;  or 
rclcnulnj;  of  r.  sttnidard  Inatreocnt  ratin;;  la  a  major  objective  but  docs  not 
have  to  ot*  eccomliehcd.  It  a  ntriont  does  not  receive  a  litnixlard  Instinmont 
rntln.'  ct  least  a  majority  of  the  traintn;:  toward  thet  poftl  i:as  been  dene  by 
us  and  t^ic  training  load  oa  the  new  unit  has  been  reduced  ccnslderably, 

3.  Another  couetderation  riost  be  given  to  the  student  v!'.o  hnn  never  possessed 
a  ctnndsrd  iiistrunent  rating  and  l3  attendin':  the  couree  on  a  waiver  ol 

the  orercqulsltcs.  It  Koold  not  be  fair  to  consider  bln  a  nongrarluate  of  the 
c.ouryc  if  ho  could  not  succossfully  corapietc  a  stenderd  Instrument  chec!:rldo 
vhon  the  course  was  never  developed  to  a'^ard  an  InitleJ.  Iseuc  of  an  instrur.eat 
rating. 

4.  In  the  future,  cases  liV.e  ^Injor  T'evlln’s  will  be  precluded  by  a  procedure 
to  annotate  thu  grade  book  when  an  Instru'ssnt  rating  has  not  been  obtained. 


.  EbTvTON 

rAi^  T  A 

Director  of  Training 


\  1  \\  'viJ^  i'*  / 


C?: 

r>orT  -  Ops  Br 

■^piDO'T-  Cr, irns  Div 
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APPENDIX  D 

Course  or  Phase  Training  Questionnaire 


COlIRSE  OR  PHASE  OF  TRAINING  QITESTIONNAIR?: 

This  questionnaire  is  to  be  used  as  input  to  the  internal  evaluation 
program.  The  purpose  of  this  survey  is  to  determine  how  students  view 
their  flight  instruction  at  the  end  of  each  phase  or  course.  There¬ 
fore,  similar  questionnaires  will  be  administered  more  than  one  time. 
The  data  will  be  used  ior  statistical  purposes  only. 

INSTRUCTIONS 

The  questionnaire  has  a  scale  at  the  top  of  each  page: 

A  -  Agree 

B  -  Disagree 

C  -  Unable  to  Comment 

Following  the  numbers  on  your  questionnaire  are  the  letters  A,  B,  and  C 
For  each  item  select  the  best  response.  For  example,  if  you  agree  with 
statement  number  one,  you  would  circle  letter  A  on  the  questionnaire. 

If  you  are  unable  to  answer  a  particular  question,  circle  letter  C. 

Do  the  same  for  each  of  the  following  statements.  The  scale  appears  at 
the  top  of  the  page  on  the  questionnaire.  The  third  page  of  the 
questionnaire  is  reserved  for  your  constructive  comments  about  your 
training.  When  vou  have  completed  the  questionnaire,  turn  it  in  to 
your  Flight  Commander, 


APPENDIX  D 


A  D  11 

C  T  N 

K  S  AC 

E  A  B  0 

E  G  L  M 

REM 
E  E 
E  T  N 
0  T 


The  outside  assignments  by  my  flight  instructor 
helped  me  to  master  the  flying  skills  in  this 
phase/course . 


ABC 


The  skills  in  this  phase  of  training  were 
difficult  to  master. 


ABC 


The  quality  of  flight  instruction  in  this  phase 
of  training  was  outstanding. 


ABC 


The  flight  instruction  was  well  organized  and 
little  time  was  wasted. 


ABC 


My  instructor  was  knowledgeable  in  all  aspects 
of  training. 


ABC 


The  flight  instructors  treated  me  with  respect. 


ABC 


The  end-of-phase  evaluations  which  1  received 
were  fair. 


ABC 


The  maneuvers  evaluated  were  proportionate  to  the 
emphasis  placed  on  them  by  my  instructor  pilot. 


ABC 


I  am  confident  in  my  ability  to  function  as  a 
pilot  in  those  maneuvers  taught  in  this  phase/course. 


ABC 


I  feel  confident  that  I  can  perform  in  a  tactical 
situation. 


ABC 


The  flight  commander's  briefings  before  each 
flight  period  helped  me  to  prepare  for  the  day's 
instruction. 


A  B  C 


2.  The  debriefings  by  my  instructor  pilot  were 

Benc’ficial  toward  correcting  any  flight  deficiencies. 


A  H  C 


13. 


1  was  allowed  to  perform  nonsLan<lard  maneuvers  with¬ 
out  my  instructor  beint;  constantly  on  the  controls. 


ABC 


14. 

I  feel  capable  of  performing  under  instrument 
conditions  in  a  tactical  environirient . 

A 

B 

C 

IS. 

1  feel  confident  concerning  operating  an  aircraft 
at  night. 

A 

B 

C 

1  ieel  that  1  needed  additional  training  on  the  following  flight 
maneuvers  for  the  reasons  indicated: 


What  constructive  criticism  do  you  have  that  could  improve  this  train 


COMBAT  AVIATOR  REFRESHER  TRAINING  COURSE  PROPOSAL 

(CARTC) 

The  CARTC  draft  proposal,  2C-F31,  was  a  working  document  during  the 
time  period  of  this  evaluation.  Since  the  start  of  the  RWARTC 
evaluation,  the  CARTC  proposal  has  undergone  several  major  changes. 
Due  to  these  changes  and  the  fact  that  the  document  was  reviewed 
informally  as  a  service  to  the  course  developers,  the  decision  was 
made  not  to  publish  the  draft  proposal  as  part  of  the  RWARTC  evalua¬ 
tion  report. 

However,  a  copy  of  the  draft  is  on  file  at  the  Evaluation  Division 
of  DES  and  should  also  be  available  at  the  Flight  Systems  Branch  of 
DTD.  The  Evaluation  Division  copy  is  on  file  with  RWARTC  evaluation 
historical  research  file. 
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DISPOSITION  FORM 

For  uM  O*  thit  form.  AR  340-15.  th«  proponant  «g»ncy  it  TAGO. 


S:  31  August  1981 


REFEBENCE  OB  OFFICE  SVMBOL 

AT/.Q-KS-K 


DC!) 

DTD 


Rotary  Wing  Aviator  Refresher  Training  Course 
(RWARTC)  Evaluation 


DES  11  AUG  1981 

CRT  Shi vers/mkp/ A69 1 


1.  The  attached  draft  evaluation  report  for  the  RWARTC  is  submitted  for  review  and  cominent 
lirior  to  publication. 

2.  Request  that  all  comments  and  observations  be  submitted,  in  DA  Form  2028  format,  by 
31  Aug  8 1 . 

3.  POC,  for  this  action,  is  CPT  Shivers,  4691/6571. 


1  Incl 


iJm. 


GEORGE  F.  NEWTON 
Colonel,  Infantry 
Director 


ATZQ-D-CC  (11  Aug  81) 


TO  DES 


FROM  DCD 


DATE  20  Aug  81 
Mr.  Wlcker/egb/3489 


CMT  2 


1.  The  draft  evaluation  report  for  the  RWARTC  has  been  reviewed.  The  information  contained 

In  tlie  report  appears  to  be  factual  and  comprehensive.  No  changes  to  the  report  are  recommend¬ 
ed  . 

2.  The  necessity  to  circulate  this  report  for  review  and  to  publish  it  as  an  official  document 
tliat  is  subject  to  distribution  outside  the  Aviation  Center  is  questionable.  The  report  is 
viewed  as  a  complimentary  evaluation  to  provide  informal  feedback  to  the  course  developers 

and  to  facilitate  refinement  of  the  forthcoming  POI  change.  Assuming  this  is  the  purpose, 
the  exchange  of  information  should  be  limited  to  the  directorates  involved. 


1  Incl 


Colonel,  Armor 

Director  of  Combat  Developments 


\'’pi:ndix  I 


DA  2496 


PREVIOUS  EDITIONS  WILL  BE  USED 


S:  31  Auf’ijsl  198  1 


DISPOSITION  FORM 

For  ut*  of  trut  form.  •••  AH  340  10.  propor<«nt  •yency  it  T  AGO 


Rf  F6RENCE  OR  OFFICE  SYMBOL 


ATZQ-KS-K 


Rotary  Wing  Aviator  Refresher  Training  Course 
(RWARTC)  Kvaluntion 


FROM  DES 


11  AUG  1981 

CRT  Shiver s /mkp/469 ] 


1.  The  attached  dratt  evaluation  report  for  the  RWARTC  is  submitted  for  review  and  comment 
prior  to  publication. 

2.  Keque.st  that  all  comments  and  observations  be  submitted,  in  DA  Form  2028  format,  by 
31  Aug  81 . 

3.  POC,  for  this  action,  is  CPT  Shivers,  4691/6571. 


1  Incl 


kL.  d 


CEORGE  F.  NEWTON 
Colonel,  Infantry 
Director 


ATZQ-TD  (11  Aug  81) 

TO  UES-E 

ATTN:  Cl’l  Shivers 


FROM  DTD 

Mr.  Newsom 


DATE  8  September  1981  CMT  2 
Mr.  Newsom/dsp/3096 


1.  DTD  appreciates  the  opportunity  to  review  and  comment  on  the  draft  evaluation  report 
for  RWARTC. 

2.  The  re[)ort  is  thorough  and  well  written.  Comments  on  attached  DA  Form  2028  are  minor. 
Some  identify  typographical  errors  and  some  are  intended  to  clarify  or  strengthen  points 
under  discussion. 

3.  lliis  ri’-sponse  confirms  Information  provided  telephonically  and  is  submitted  after  tlu 
suspense  in  Comment  I  per  telephone  conversation  between  CPT  Shivers  and  Mr.  Newsom. 


wd  Incl  1 
Added  1  I  III  1 
2.  DA  Ferm  2028 


ERNEST  F.  ESTES 
COL,  FA 

Director  of  Training  Develn[iiii(‘nts 


2496 


rnj  vu)u^  I  niTioNS  will  bf  usfp 


V-  .y  .. 


RECOMMENDED  CHANGES  TO  PUBLICATIONS  AND  date 

Rl  AMV  RnoUC  P®’’*  U  trevense)  for  Repair  Parts  and 

Dl.A^4^  rUKMd  Spec  ial  Tool  Lists  (RPSTL)  and  Supply  J  Sep  81 

Foi  Vis<  o(  iFi*  totm,  sae  AR  310-1;  tha  proponant  agency  it  iWe  US  Cata logs /Supply  Manuals  (SC/SM). 

Army  Adjutant  General  Center. 


TOt  ft)  propffnrnt  ol  publicat  ion  or  form)  fine  lude  ZIP  Code)  I  FROM:  (Ai.-tivity  and  local  ion)  (Incftide  ZIP  Code) 


Director,  DES 

ATTN:  ATZQ--ES-E  (CTT  Shivers) 
Ft  Rucker,  AL  36362 


TEM  PAGE  PARA-  LINE  FIGURE  TABLE 

NO  NO.  GRAPH  NO.*  NO.  NO. 


Director,  DTD 

ATTN:  ATZQ-TD  (Mr.  Newsom) 
Ft  Rucker,  AL  36362 


PART  I  -  ALL  PUBLICATIONS  (EXCEPT  RPSTL  AND  SC  SM)  AND  BLANK  FORMS 


Julv  1981 


''’'''’'-E  Rotary  Wing  Aviator  Refresher 
Training  Course  (RWARTC)  Evaluation 


RECOMMENDED  CHANGES  AND  REASON 
(Exact  H  ording  of  recommended  change  muat  be  given) 


Delete:  "1973." 

Reason:  Extraneous  entry. 

Add  to  the  sentence:  ",  .  .design  program  but  is 
designed  in  accordance  with  Chapter  3,  Refresher 
Training,  TC  1-135." 

Reason:  To  identify  one  basis  of  design. 

Delete:  "by  LTC  Epperson." 

Reason:  Not  required  for  identification.  The 
memorandum  is  included  as  Tab  B  and  is  signed  by 
LTC  Epperson. 

Para  l-4q  should  be  para  l-4g. 

Reason:  Typographical  error  (typo). 

Cri-tiques  should  be  critiques. 

Reason:  Typo. 

Neces-sarily  should  be  necessarily. 

Reason:  Typo. 

Overtime  should  be  over  time. 

Reason:  Changes  meaning. 

Principals  should  be  principles. 

Reason:  Correct  spelling. 

Suggest  tasking  be  assigned  DTD. 


*  Hcfrrf'ncf  to  line  numbers  within  the  pnra^raph  or  subpiir^i^rriph. 


SIG  NA  T  URE 


- 


2028 


RF^LACFS  DA  fORM2:2a  •  11  EC  60.  WHICH  vMl-L.  BE  USED 


ATZQ-T-TM  (11  Aug  81) 

SUB.IlC’l :  Rotary  Wing  Aviator  Refresher  Training  Course  (RWARTC)  Evaluation 

XO  Df'S  FROM  DOTD  DiFl’B^SEP  198iM; 

CPT  Alexander/ u  /  P  '* 


1.  In  accordance  with  Para  2  of  CMT  1,  DOTD  has  reviewed  the  attached  Rotary  Wing 
Aviator  Course  Evaluation. 

2.  Evaluation  comments  are  provided  at  Incl  2  and  3  as  requested. 


RWARTC  has  been  reviewed;  the  following  cominents  provided; 


a.  Pg  5 ,  para  6.  USAAVNC  Reg  350-14  has  be  in  rewritten  and  replaced  by  USAAVNC 
350-15.  USAAVNC  academic  examinations  are  being  rewritten  to  conform  to  USAAVNC 
350-15;  a  holdup  in  this  area  is  the  requirement  to  write  POI  entries  lAW  TRADOC 
Reg  350-7  which  is  new.  This  should  be  completed  in  FY  82.  Test  outlines  are  pre¬ 
pared  and  can  be  made  available  to  anyone  desiring  to  see  them.  End-of -course 
examination  procedures  are  new  and  complex.  Latest  guidance  indicates  they  will  be 
used  in  AIT  courses  only, 

b.  Page  39.  'Jew  exams  are  not  expected  to  be  made  within  the  confines  of  USAAVNC 
Reg  350-14,  insteai  350-15  will  be  used.  The  only  courses  that  have  undergone  the 
IPISD  process  at  tne  USAAVNC  are  the  93H,  93J,  and  71P.  Documentation  for  courses 
that  have  not  undergone  the  ISD  process  would  no;  bfi  in  a  standardized  format  or 

may  be  nonexistent, 

FOR  THE  DIRECTOR: 


1  Incl 
nc 


1.  A  comprehensive  review  of  the  draft  report  has  been  completed  as  requested.  Selected 
data  from  Classes  81-1  throufe,h  81-40  was  extracted  from  local  files,  and  a  comparison  was 
made  v;ith  the  findings  aocumented  from  Class  80-19  through  80-28  in  the  report.  No  signifi 
cant  differences  were  discovered;  in  fact,  the  data  extracted  from  the  later  group  tended 
to  support  the  data  collected  by  DES  from  the  earlier  classes.  Student  critiques  from  the 
later  group  contained  the  same  narratives  praising  the  professionalism  of  the  IP's  and  the 
2C35  Instructors,  but  did  not  indicate  any  negative  comments  concerning  frequent  IP  changes 
Recent  class  outbriefings  have  generally  indicated  that  weaker  students  view  IP  changes  as 
hindering  learning  while  better  students  welcome  IP  changes  as  offering  a  broader  view  of 
experience  from  which  to  learn. 

2.  The  following  data  of  interest  was  extracted  from  the  later  group  of  classes  and  is 
included  in  this  review  for  , information  only.  Of  the  383  military  aviators  evaluated  in 
the  later  group,  28  arrived  for  training  with  a  current  instrument  rating,  while  26  had 
never  possessed  a  standard  ticket  (23  did  have  a  tactical  instrument  rating) .  The  average 
amount  of  time  away  from  flying  was  3.4  years  with  extremes  running  five  months  and  16 
years.  A  large  concentration  was  at  the  two-year  point,  and  a  lesser  concentration  v'as 
around  the  ten-year  mark.  Two  important  points  come  from  this  data.  One  is  that  fewer 
aviators  arrive  without  having  possessed  an  initial  instrument  rating.  Two  is  that  fewer 
aviators  have  been  away  from  flying  in  excess  of  three  years.  These  two  factors  also 
account  for  the  average  number  of  flight  training  hours  dropping  slightly  to  25.9  hours. 

3.  It  is  not  a  recommendation  that  the  above  data  be  Included  in  the  DES  report.  Ihe 
supplemental  information  is  annotated  here  for  information  purposes  only  and  to  show  that 
a  comparison  of  later  data  served  to  confirm  the  findings  of  the  earlier  data  in  the  DES 
report  with  only  few  exceptions  based  on  more  current  data.  No  significant  discrepancies 
to  the  original  report  were  noted,  either  in  the  findings  presented  or  the  format. 

Separate  action  to  resolve  problems  identified  in  paragraph  5  are  currently  underway. 

4.  Concur  with  the  draft  report  as  written. 


1  Incl 


ROBERT  R.  PARKS 
■  LTC,  FA 

Cdr,  Cairns  Division 


distribution 


Coimoander 

US  Army  Military  Personnel  Center 
ATTN :  DAPC-MSP-S 
200  Stovall  Street 
Alexandria,  VA  22332  2 

Commander 

US  Army  Training  and  Doctrine  Command 
ATTO :  ATTNG-EV 

Fort  Monroe,  VA  23651  2 

Commandant 

US  Army  Air  Defense  School 
ATTN:  Director  of  Evaluation 
Fort  Bliss,  TX  79916  1 

Coisniandant 

US  Army  Armor  School 

ATTN:  Director  of  Evaluation 

Fort  Knox,  KY  40121  1 

Commandant 

IS  Army  Engineer  School 
ATTN:  Director  of  Evaluation 
Fo?t  Belvoir,  VA  22060  1 


C('..’.ri.uidant 

US  Army  Infantry  School 
ATTN.  Director  of  Evaluation 
Fort  B'^nning,  GA  31905  1 


Commandant 

US  Army  Transportation  School 
AT'''N:  Di  rector  of  Evaluation 
For  '  Fiistis,  VA  23604  1 

Cornu  riidant 

US  Army  rield  Artillery  School 
ATTN:  ’Urector  of  Evaluation 
Fort  SiJl,  OK  73503  1 

Cominandant 

US  Army  Tn t ell Lgence  School 
ATTH:  D.' rector  of  Evaluation 
Fort  duachuca,  AZ  85613  1 


Commandant 

US  Army  Signal  School 

ATTN:  Director  of  Evaluation 

Fort  Gordon,  GA  30905  1 


Commandant 

US  Army  Institute  of  Administration 
ATTN:  Director  of  Evaluation 
Fort  Benjamin  Harrison,  IN  46216  1 

Commandant 

US  Army  Military  Police  School 
ATTN:  Director  of  Evaluation 
Fort  McClellan,  AL  36201  1 

Commandant 

US  Army  Chaplain  School 

ATTN:  Director  of  Evaluation 

Fort  Wadsworth,  NY  10305  1 

Commandant 

US  Army  Communciations-Electronics 
School 

ATTN:  Director  of  Evaluation 
Fort  Monmouth,  NJ  07703  1 

Commandant 

US  Army  Institute  for  Military 
Assistance 

ATTN:  Director  of  Evaluation 
Fort  Bragg,  NC  28307  1 

Commandant 

US  Army  Missile  &  Munitions  School 
ATTN:  Director  of  Evaluation 
Redstone  Arsenal,  AL  35809  1 

Commandant 

US  Army  Ordnance  School 
ATTN:  Director  of  Evaluation 

Aberdeen  Proving  Ground,  MD  21005  1 

Commandant 

US  Army  Quartermaster  School 
ATTN:  Director  of  Evaluation 
Fort  Lee,  VA  23801  1 
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Coniniandant 

US  Army  Scrgfants  Major  Academy 
AT'rN;  Director  of  Evaluation 
rort  Bliss,  fX  79918  1 

Commandant 

US  Army  Element,  School  of  Music 
ATTN:  Director  of  Evaluation 
Norrolk,  VA  23521  1 

Commandant 

Defense  Information  School 

A'lTN:  Director  of  Evaluation 

Fort  Benjamin  Harrison,  IN  46216  1 

Commandant 

Defense  Language  Institute 
ATTN:  Director  of  Evaluation 
Presidio  of  Monterey,  CA  93940  1 

Conraandant 
Defense  Language 
English  Language  Center 
ATTN;  Director  of  Evaluation 
Lackland  AFB,  T>:  78236 


Comoander 

US  Army  Aviation  Center 

ATTN:  ATZQ-DCG 

Fort  Rucker,  AL  36362 

Commander 

US  Army  Aviation  Center 

ATTN:  ATZQ-ES 

Fort  Rucker,  AL  36362 

Commander 

US  Army  Aviation  Center 

ATTN:  ATZQ-T 

Fort  Rucker,  AL  36362 

Commander 

US  Army  Aviation  Center 

ATTN:  ATZQ-TD 

Fort  Rucker,  AL  36362 
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